-- Logs begin at Thu 2021-10-28 07:55:31 UTC, end at Thu 2021-10-28 09:08:40 UTC. -- Oct 28 08:31:17.183594 dv-cinder-815659-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 08:31:17.192313 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 08:31:17.194985 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 28 08:31:17 2021] *** Oct 28 08:31:17.194985 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 08:31:17.194985 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 08:31:17.194985 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: nodename: dv-cinder-815659-2-iscsi Oct 28 08:31:17.194985 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: machine: x86_64 Oct 28 08:31:17.194985 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: clock source: unix Oct 28 08:31:17.194985 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: pcre jit disabled Oct 28 08:31:17.194985 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: detected number of CPU cores: 4 Oct 28 08:31:17.194985 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: current working directory: / Oct 28 08:31:17.194985 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: detected binary path: /usr/bin/uwsgi-core Oct 28 08:31:17.194985 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: your processes number limit is 47680 Oct 28 08:31:17.194985 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: your memory page size is 4096 bytes Oct 28 08:31:17.194985 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: detected max file descriptor number: 2048 Oct 28 08:31:17.196378 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: lock engine: pthread robust mutexes Oct 28 08:31:17.196378 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: thunder lock: enabled Oct 28 08:31:17.196378 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 08:31:17.196378 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 28 08:31:17.239541 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: Python main interpreter initialized at 0x55e695b8b9c0 Oct 28 08:31:17.239541 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: python threads support enabled Oct 28 08:31:17.239541 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: your server socket listen backlog is limited to 100 connections Oct 28 08:31:17.239541 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: your mercy for graceful operations on workers is 90 seconds Oct 28 08:31:17.239931 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 08:31:17.239931 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: *** Operational MODE: preforking *** Oct 28 08:31:17.240800 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: *** uWSGI is running in multiple interpreter mode *** Oct 28 08:31:17.240800 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: spawned uWSGI master process (pid: 107291) Oct 28 08:31:17.241018 dv-cinder-815659-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 28 08:31:17.244962 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: spawned uWSGI worker 1 (pid: 107292, cores: 1) Oct 28 08:31:17.244962 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: spawned uWSGI worker 2 (pid: 107293, cores: 1) Oct 28 08:31:17.244962 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 08:31:18.892814 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 08:31:18.892814 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: from cryptography.utils import int_from_bytes Oct 28 08:31:18.893516 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 08:31:18.893516 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: from cryptography.utils import int_from_bytes Oct 28 08:31:18.907659 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 08:31:18.907659 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: from cryptography.utils import int_from_bytes Oct 28 08:31:18.908173 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 08:31:18.908173 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: from cryptography.utils import int_from_bytes Oct 28 08:31:21.519375 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 08:31:21.519999 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 08:31:21.520367 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 08:31:21.520477 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 08:31:21.520562 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 08:31:21.520648 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 08:31:21.520736 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 08:31:21.520819 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 08:31:21.520896 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 08:31:21.520974 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 08:31:21.521057 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.521147 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.521353 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.521672 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.522078 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.522160 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.522229 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.522306 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.522384 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.522452 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.522650 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.522759 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.522956 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.523085 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.523278 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.523406 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.523608 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.523737 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.523874 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.524000 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.524194 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.524318 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.524521 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815659-2-iscsi {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.524645 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815659-2-iscsi {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.524849 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.524970 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.525158 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.525278 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.525471 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.525572 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.525796 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.525894 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.526104 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.526195 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.526427 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.526538 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.526765 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.526862 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.527269 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.527373 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.527709 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.527823 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.528019 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.528121 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.528333 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.528443 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.528687 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.528802 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.528983 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.529066 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.529300 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.529398 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.529616 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.529712 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.529927 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.530012 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.530250 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.530345 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.530584 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.530689 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.530990 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815659-2-iscsi {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.531086 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815659-2-iscsi {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.531309 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.531394 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.531622 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.531703 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.531936 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.532027 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.532349 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.532479 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.532662 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.532759 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.532972 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.533071 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.533295 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.533381 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.533620 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.533706 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.533932 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.534018 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.534390 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.534507 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.534747 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.534879 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.535073 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.535282 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.535402 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.535525 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.535710 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.535796 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.536082 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.536181 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.536399 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.536484 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.536723 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.536868 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.537592 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.537982 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.538102 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.538196 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.538196 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.538394 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.538542 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.538646 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.538864 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.538983 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.539187 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.539323 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.539520 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.539633 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.539780 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.539891 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.540038 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.540149 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.540356 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.540450 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.540679 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.540777 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.540990 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.541089 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.541299 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.541384 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.541609 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.541703 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.541919 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.542014 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.542226 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.542312 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.542557 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.542648 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.542872 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.542960 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.543180 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.543271 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.543504 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.543605 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.543818 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.543904 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.544143 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.544242 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.544453 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.544539 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.544772 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.544858 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.545172 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.545262 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.545427 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.545519 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.545741 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.545877 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.546077 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.546191 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.546400 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.546525 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.546746 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.546871 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.547061 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.547184 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.547386 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.547491 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.547695 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.547788 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.548004 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.548097 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.548312 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.548421 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.548634 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.548721 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.548962 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.549048 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.549273 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.549372 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.549566 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.549658 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.549840 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.549975 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.550140 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.550233 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.550460 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.550621 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.550798 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.550884 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.551106 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.551192 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.551414 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.551498 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.551716 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.551801 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.552025 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.552112 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.552333 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.552417 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.553222 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.553472 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.553571 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.553797 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.554019 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.554113 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.554335 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.554428 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.554679 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.554770 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.554996 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.555131 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.555311 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.555414 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.555638 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.555731 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.555968 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.556164 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.556276 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.556543 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.556731 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.556816 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.556883 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.556954 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.557175 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.557279 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.557499 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.557593 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.557811 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.557903 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.558120 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.558205 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.558442 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.558599 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.558779 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.558865 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.559088 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.559185 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.559409 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.559503 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.559722 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.559806 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.560034 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.560131 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.560357 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.560442 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.560661 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.560744 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.560969 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.561061 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.561359 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.561587 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.561673 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.561751 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.561889 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.561985 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.562185 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.562270 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.562509 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.562596 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.562822 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.562915 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.563130 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.563222 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.563434 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.563526 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.563740 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.563829 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.564042 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.564133 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.564403 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.564503 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.564685 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.564772 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.564998 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.565310 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.565401 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.565621 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.565717 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.565950 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.566037 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.566273 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:31:21.566357 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.566637 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.566727 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.566979 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.567063 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.567301 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.567387 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.567635 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.567729 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.567971 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.568058 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.568328 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.568411 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.568650 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.568817 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.569059 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.569199 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.569382 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.569477 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.569715 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.569801 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.570034 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.570155 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.570358 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.570453 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.570702 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.570801 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.571032 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.571117 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.571353 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.571449 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.571675 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.571769 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.571995 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.572087 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.572317 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.572410 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.572633 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.572719 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.572948 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.573042 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.573280 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.573379 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.573599 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.573694 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.573916 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.574003 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.574231 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.574330 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.574598 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.574689 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.574929 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.575014 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.575248 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.575350 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.575567 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.575655 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.575882 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.575974 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.576202 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.576296 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.576516 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.576601 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.576902 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.577003 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.577147 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.577241 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.577471 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.577556 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.577790 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.577888 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.578103 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.578199 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.578436 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.578552 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.578784 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.578871 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.579097 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.579183 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.579405 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.579524 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.579715 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.579842 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.580027 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.580162 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.580339 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.580435 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.580644 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.580738 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.580967 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.581052 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.581286 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.581417 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.581594 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.581688 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.581927 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.582011 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.582312 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.582446 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.582556 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.582651 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.582870 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.582957 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.583187 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.583279 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.583498 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.583586 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.583833 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.583919 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.584166 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.584394 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.584492 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.584578 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.584783 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.584871 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.585108 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.585196 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.585419 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.585514 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.585730 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.585816 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.586042 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.586127 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.586358 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.586445 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.586700 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.586788 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.587018 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.587194 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.587334 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.587466 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.587651 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.587738 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.587966 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.588063 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.588282 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.588369 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.588622 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.588717 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.588934 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.589028 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.589256 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.589341 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.589586 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.589681 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.589904 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.589997 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.590216 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.590302 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.590543 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.590632 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.590855 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.590943 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.591162 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.591247 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.591470 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.591561 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.591777 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.591901 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.592084 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.592172 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.592391 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.592475 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.592697 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.592784 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.593004 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.593089 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.593310 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.593394 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.593615 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.593701 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.593937 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.594022 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.594248 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.594342 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.594583 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.594672 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.594894 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.594980 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.595203 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.595301 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.595540 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.595626 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.595847 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.595939 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.596192 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.596287 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.596523 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.596608 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.596842 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.596933 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.597157 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.597251 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.597470 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.597563 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.597785 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.597870 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.598098 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.598184 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.598409 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.598528 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.598750 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.598847 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.599064 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.599151 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.600038 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.600230 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.600230 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.600385 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.600538 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.600614 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.600850 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.600934 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.601171 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.601261 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.601482 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.601574 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.602192 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.602292 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.602292 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.602452 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.602567 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.602650 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.602764 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.602851 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.603102 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.603197 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.603420 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.603508 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.603734 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.603820 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.604046 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.604140 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.604362 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.604453 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.604674 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.604766 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.604988 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.605082 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.605299 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.605384 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.605610 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.605765 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.605925 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.606024 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.606236 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.606328 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.606663 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.607027 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.607220 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.607317 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.607477 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.607588 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.607787 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.607915 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.608109 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.608228 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.608418 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.608551 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.608737 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.608886 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.609067 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.609227 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.609404 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.609544 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.609733 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.609866 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.610032 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.610194 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.610360 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.610638 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.610723 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.610843 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.611006 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.611161 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.611323 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.611473 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.611633 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.611787 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.611943 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.612105 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.612260 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.612426 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.612576 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.612746 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.612893 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.613063 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.613207 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.613374 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.613518 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.613695 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.613837 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.614009 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.614150 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.614320 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.614458 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.614659 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.614790 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.614978 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.615765 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.615875 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.616097 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.616185 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.616453 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.616541 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.616786 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.616895 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.617110 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.617199 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.617421 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.617513 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.617733 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.617825 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.618053 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.618142 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.618420 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.618578 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.618700 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.618786 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.619009 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.619104 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.619316 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.619401 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.619665 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.619760 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.619983 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.620074 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.620300 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.620395 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.620619 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.620759 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.620934 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.621019 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.621246 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.621338 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.621562 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.621660 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.621875 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.621960 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.622193 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.622281 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.622529 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.622631 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.622853 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.622940 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.623170 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.623255 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.623483 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.623570 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.623798 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.623888 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.624113 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.624206 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.624430 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.624517 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.624746 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.624830 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.625058 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.625145 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.625374 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.625462 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.625683 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.625770 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.625989 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.626074 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.626304 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.626392 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.626651 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.626923 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.627219 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.627317 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.627555 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.627645 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.627874 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.627960 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.628197 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.628292 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.628518 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.628611 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.628840 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.628926 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.629171 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.629264 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.629489 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.629583 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.629802 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.629888 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.630115 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.630202 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.630427 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.630531 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.630789 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.630882 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.631101 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.631309 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.631416 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.631628 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.631721 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.631942 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.632042 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.632254 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.632382 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.632572 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.632666 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.632885 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.632987 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.633197 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.633290 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.633536 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.633628 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.633845 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.633943 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.634165 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.634272 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.634473 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.634574 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.634812 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.634914 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.635119 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.635215 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.635447 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.635534 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.635759 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.635852 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.636064 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.636167 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.636374 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.636460 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.636678 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.636770 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.637026 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.637138 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.637331 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.637419 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.637672 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.637811 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.638003 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.638091 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.638346 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.638432 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.638681 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.638770 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.638991 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.639089 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.639317 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.639421 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.639625 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.639719 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.639938 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.640026 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.640245 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.640331 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.640556 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.640651 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.640866 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.640954 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.641171 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.641258 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.641482 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.641577 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.641795 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.641881 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.642108 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.642195 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.642419 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.642608 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.642751 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.642852 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.643063 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.643159 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.643369 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.643464 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.643685 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.643773 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.644002 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.644098 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.644312 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.644417 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.644613 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.644721 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.644926 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.645018 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.645239 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.645328 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.645544 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.645630 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.645855 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.645941 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.646162 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.646295 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.646592 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.646708 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.646838 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.646934 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.647146 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.647241 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.647454 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.647547 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.647765 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.647860 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.648078 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.648164 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.648385 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.648478 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.648713 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.648807 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.649027 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.649113 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.649336 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.649422 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.649647 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.649742 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.649960 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.650054 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.650265 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.650351 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.650594 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.650698 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.650911 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.651047 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.651235 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.651323 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.651554 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.651643 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.651861 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.651952 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.652173 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.652265 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.652480 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.652609 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.652785 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.652870 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.653091 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.653183 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.653402 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.653489 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.653708 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.653794 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.654014 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.654098 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.654318 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.654427 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.654649 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.654737 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.654955 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.655050 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.655283 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.655370 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.655596 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.655681 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.655902 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.655997 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.656211 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.656296 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.656515 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.656600 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.656860 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.656956 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.657172 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.657257 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.657533 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.657616 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.657842 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.657939 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.658159 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.658251 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.658482 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.658650 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.658819 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.658918 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.659133 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.659220 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.659452 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.659538 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.659765 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.659860 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.660085 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.660169 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.660397 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.660481 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.660714 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.660800 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.661018 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.661150 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.661324 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.661411 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.661648 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.661737 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.662518 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.662623 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.662825 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.662912 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.663150 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.663246 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.663475 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.663562 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.663800 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.663899 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.664109 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.664197 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.664451 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.664538 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.664767 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.664867 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.665082 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.665175 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.665393 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.665480 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.665706 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.665802 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.666020 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.666110 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.666366 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.666451 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.666708 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.666808 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.667023 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.667110 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.667338 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.667424 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.667648 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.667741 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.667963 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.668050 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.668273 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.668358 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.668583 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.668671 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.668912 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.668997 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.669223 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.669316 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.669532 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.669626 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.669845 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.669932 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.670159 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.670244 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.670472 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.670637 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.670807 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.670894 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.671238 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.671336 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.671556 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.671643 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.671873 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.671958 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.672179 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.672338 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.672493 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.672580 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.672807 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.672892 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.673125 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.673219 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.673442 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.673528 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.673752 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.673843 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.674168 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.674307 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.674483 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.674591 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.674820 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.674906 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.675133 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.675222 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.675441 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.675528 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.675747 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.675841 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.676062 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.676148 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.676386 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.676471 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.676696 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.676781 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.677000 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.677094 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.677308 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.677400 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.678242 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.678343 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.678583 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.678711 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.678915 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.679006 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.679335 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.679436 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.679649 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.679744 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.679964 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.680051 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.680381 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.680476 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.680698 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.680786 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.681013 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.681100 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.681341 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.681436 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.681665 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.681751 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.681992 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.682086 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.682318 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.682432 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.682644 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.682734 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.682958 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.683044 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.683284 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.683373 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.683608 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.683696 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.683918 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.684004 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.684236 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.684362 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.684566 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.684663 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.684892 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.684986 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.685219 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.685313 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.685539 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.685624 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.685866 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.685951 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.686449 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.686648 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.686648 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.686835 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.686954 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.687043 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.687354 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.687464 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.687664 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.687747 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.687905 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.687991 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.688212 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.688409 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.688523 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.688609 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.688830 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.688916 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.689136 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.689232 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.689461 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.689554 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.689766 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.689852 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.690085 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.690180 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.690399 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.690486 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.690738 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.690827 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.691046 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.691141 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.691353 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.691487 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.691677 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.691763 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.691984 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.692070 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.692308 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.692396 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.692626 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.692712 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.692949 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.693080 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.693303 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.693428 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.693613 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.693705 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.693939 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.694028 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.694253 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.694339 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.694585 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.694681 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.694896 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.694985 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.695203 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.695291 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.695553 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.695655 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.695865 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.695953 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.696190 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.696276 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.696527 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.696621 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.696857 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.696942 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.697170 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.697256 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.697508 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.697603 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.697839 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.697926 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.698155 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.698240 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.698477 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.698641 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.698828 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.698923 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.699138 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.699225 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.699448 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.699535 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.699765 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.699851 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.700074 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.700160 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.700386 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.700473 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.700699 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.700798 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.701016 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.709324 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.709455 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.709555 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.709628 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.709695 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.709760 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.709839 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.709914 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.709995 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.710131 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.710219 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.710301 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.710394 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.710475 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.710584 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.710667 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.710734 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.710818 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.710906 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.710986 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.711064 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.711141 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.711220 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.711297 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.711456 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.711550 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.711617 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.711680 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.711754 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.711754 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.711885 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.711965 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.712043 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.712120 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.712197 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.712282 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.712362 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.712479 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.712590 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.712670 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.712747 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.712833 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.712919 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.712998 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.713076 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.713159 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.713226 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.713301 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.713379 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.713457 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.713541 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.713541 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.713684 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.713787 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.713869 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.713946 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.714024 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.714108 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.714193 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.714272 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.714357 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.714436 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.714535 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.714605 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.714684 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.714684 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.714805 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.714944 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.714944 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.715089 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.715163 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.715243 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.715320 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.715397 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.715474 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.715551 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.715677 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.715765 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.715850 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.715929 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.716014 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.716103 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.716183 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.716260 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.716337 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.716519 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.716606 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.716683 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.716762 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.716828 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.716892 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.716955 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.717027 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.717114 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.717193 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.717270 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.717354 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.717437 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.717526 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.717611 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.717774 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.717872 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.718058 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.718155 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.718381 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.718468 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.718711 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.718927 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.719028 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.719106 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.719333 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.719459 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.719652 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.719811 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.719972 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.720155 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.720288 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.720490 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.720601 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.720875 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.721055 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.721198 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.721292 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.721522 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.721608 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.721847 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.721931 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.722176 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.722260 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.722512 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.722601 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.722836 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.722940 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.723159 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.723245 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.723481 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.723695 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.723794 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.724017 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.724328 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.724415 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.725271 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.725788 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.725896 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.725979 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.726069 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.726150 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.726227 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.726517 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.726621 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.726828 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.727096 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.727184 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.727442 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.727529 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.727781 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.727892 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.728064 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.728192 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.728431 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.728536 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.728711 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.728861 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.729065 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.729157 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.729333 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.729498 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.729652 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.729739 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.729980 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.730190 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.730298 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.730567 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.730670 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.730892 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.730979 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.731224 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.731496 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.731591 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.732126 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.732219 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.732435 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.732526 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.732765 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.732859 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.733079 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.733165 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.733392 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.733534 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.733714 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.733802 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.734029 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.734114 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.734338 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.734425 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.734673 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.734762 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.734992 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.735086 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.735312 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.735414 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.735618 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.735706 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.735931 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.736017 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.736237 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.736334 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.736560 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.736646 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.736866 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.736951 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.737175 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.737270 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.737485 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.737573 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.737802 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.737894 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.738110 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.738203 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.738419 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.738567 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.738755 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.738852 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.739061 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.739159 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.739376 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.739460 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.739687 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.739772 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.740001 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.740089 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.740571 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.740684 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.740766 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.740845 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.740972 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.741083 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.741285 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.741405 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.741592 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.741720 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.741920 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.742042 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.742229 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.742353 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.742557 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.742701 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.742880 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.743017 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.743197 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.743350 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.743523 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.743665 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.743839 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.743980 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.744152 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.744305 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.744505 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.744626 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.744826 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.744958 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.745280 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.745420 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.745601 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.745726 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.745958 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.746045 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.746287 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.746373 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.746810 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.746910 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.747124 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.747256 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.747436 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.747562 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.747745 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.747915 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.748071 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.748266 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.748386 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.748585 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.748700 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.748901 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.749013 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.749216 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.749327 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.749551 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.749645 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.749878 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.749966 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.750201 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.750287 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.750554 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.750645 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.750868 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.750953 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.751188 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.751283 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.751510 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.751597 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.751830 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.751915 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.752149 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.752235 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.752469 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.752563 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.752780 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.752865 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.753095 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.753192 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.753408 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.753496 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.753723 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.753821 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.754039 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.754138 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.754371 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.754456 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.754717 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.754803 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.755028 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.755125 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.755344 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.755462 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.755707 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.755971 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.756361 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.756455 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.756543 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.756623 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.756701 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.756921 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.757084 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.757250 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.757405 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.757583 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.757733 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.757902 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.758064 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.758230 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.758384 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.758573 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.758748 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.758922 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.759080 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.759270 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.759400 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.759609 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.759730 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.759941 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.760056 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.760252 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.760394 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.760561 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.760742 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.760869 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.761083 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.761170 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.761419 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.761506 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.761736 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.761873 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.762051 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.762146 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.762365 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.762451 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.762711 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.762801 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.763056 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.763142 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.763381 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.763466 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.763718 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.763851 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.764025 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.764110 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.764338 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.764422 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.764663 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.764749 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.764976 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.765068 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.765291 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.765385 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.765604 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.765692 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.765919 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.766006 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.766234 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.766328 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.766572 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.766663 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.766905 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.767000 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.767228 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.767323 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.767536 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.767623 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.767858 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.767943 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.768176 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.768274 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.768501 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.768587 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.768823 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.768908 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.769136 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.769222 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.769514 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.769607 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.769788 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.769876 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.770106 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.770201 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.770421 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.770521 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.770768 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.770855 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.771089 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.771176 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.771950 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.772346 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.772346 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.772497 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.772565 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.772738 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.772893 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.773071 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.773212 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.773407 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.773538 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.773759 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.773873 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.774080 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.774212 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.774442 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.774581 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.774805 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.774903 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.775055 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 08:31:21.775239 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.775563 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.775918 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.776257 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:31:21.776508 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 08:31:21.798044 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG oslo_db.sqlalchemy.engines [None req-99f7341d-8b50-481e-963e-4d2677f5e9d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107293) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:31:21.799228 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG oslo_db.sqlalchemy.engines [None req-c8506b18-4e35-4259-a517-55e5f0ee914b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107292) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:31:21.973375 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.context [None req-c8506b18-4e35-4259-a517-55e5f0ee914b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a857be9c-0064-448f-960e-2be952756e52(cell1) {{(pid=107292) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 08:31:21.975183 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.context [None req-99f7341d-8b50-481e-963e-4d2677f5e9d0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a857be9c-0064-448f-960e-2be952756e52(cell1) {{(pid=107293) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 08:31:21.977934 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c8506b18-4e35-4259-a517-55e5f0ee914b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:31:21.979559 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-99f7341d-8b50-481e-963e-4d2677f5e9d0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:31:21.979693 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c8506b18-4e35-4259-a517-55e5f0ee914b None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:31:21.980375 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c8506b18-4e35-4259-a517-55e5f0ee914b None None] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:31:21.981140 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-99f7341d-8b50-481e-963e-4d2677f5e9d0 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:31:21.982218 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-99f7341d-8b50-481e-963e-4d2677f5e9d0 None None] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:31:21.982608 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c8506b18-4e35-4259-a517-55e5f0ee914b None None] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:31:21.984178 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-99f7341d-8b50-481e-963e-4d2677f5e9d0 None None] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:31:21.994437 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG oslo_db.sqlalchemy.engines [None req-c8506b18-4e35-4259-a517-55e5f0ee914b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107292) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:31:21.996677 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG oslo_db.sqlalchemy.engines [None req-c8506b18-4e35-4259-a517-55e5f0ee914b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107292) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:31:22.000650 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG oslo_db.sqlalchemy.engines [None req-99f7341d-8b50-481e-963e-4d2677f5e9d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107293) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:31:22.002820 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG oslo_db.sqlalchemy.engines [None req-99f7341d-8b50-481e-963e-4d2677f5e9d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107293) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:31:22.265564 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG oslo_db.sqlalchemy.engines [None req-c8506b18-4e35-4259-a517-55e5f0ee914b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107292) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:31:22.272821 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG oslo_db.sqlalchemy.engines [None req-99f7341d-8b50-481e-963e-4d2677f5e9d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107293) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:31:22.614755 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: WARNING keystonemiddleware.auth_token [None req-c8506b18-4e35-4259-a517-55e5f0ee914b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 08:31:22.622092 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: WARNING keystonemiddleware.auth_token [None req-c8506b18-4e35-4259-a517-55e5f0ee914b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 08:31:22.627172 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: WARNING keystonemiddleware.auth_token [None req-99f7341d-8b50-481e-963e-4d2677f5e9d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 08:31:22.634787 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: WARNING keystonemiddleware.auth_token [None req-99f7341d-8b50-481e-963e-4d2677f5e9d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 08:31:22.971327 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: WARNING keystonemiddleware.auth_token [None req-c8506b18-4e35-4259-a517-55e5f0ee914b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 08:31:22.976957 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: WARNING keystonemiddleware.auth_token [None req-c8506b18-4e35-4259-a517-55e5f0ee914b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 08:31:22.983424 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e695b8b9c0 pid: 107292 (default app) Oct 28 08:31:22.985485 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-c8506b18-4e35-4259-a517-55e5f0ee914b None None] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:31:22.986710 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-c8506b18-4e35-4259-a517-55e5f0ee914b None None] 10.222.0.76 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001734 Oct 28 08:31:22.987137 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 1/1] 10.222.0.76 () {50 vars in 788 bytes} [Thu Oct 28 08:31:22 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:31:22.988342 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: WARNING keystonemiddleware.auth_token [None req-99f7341d-8b50-481e-963e-4d2677f5e9d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 08:31:22.994878 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: WARNING keystonemiddleware.auth_token [None req-99f7341d-8b50-481e-963e-4d2677f5e9d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 08:31:23.001154 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e695b8b9c0 pid: 107293 (default app) Oct 28 08:32:46.193212 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-c8506b18-4e35-4259-a517-55e5f0ee914b None None] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:32:46.194211 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-c8506b18-4e35-4259-a517-55e5f0ee914b None None] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Oct 28 08:32:46.194628 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 2/2] 10.222.0.76 () {54 vars in 930 bytes} [Thu Oct 28 08:32:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:32:46.637495 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-c89a0768-d246-45fc-b03f-53c797a7b928 admin admin] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:32:46.667911 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-c89a0768-d246-45fc-b03f-53c797a7b928 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.465353 Oct 28 08:32:46.668810 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 1/3] 10.222.0.76 () {60 vars in 1291 bytes} [Thu Oct 28 08:32:46 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:32:49.016094 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-c8506b18-4e35-4259-a517-55e5f0ee914b None None] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:32:49.018169 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-c8506b18-4e35-4259-a517-55e5f0ee914b None None] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001904 Oct 28 08:32:49.021743 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 3/4] 10.222.0.76 () {54 vars in 930 bytes} [Thu Oct 28 08:32:49 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:32:49.082126 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-d774c6de-b867-4941-8c94-accd241bc448 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "c1", "ram": 256, "disk": 1, "swap": 0, "name": "cirros256", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:49.102285 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:32:49.102285 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Oct 28 08:32:49.134430 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-d774c6de-b867-4941-8c94-accd241bc448 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.108907 Oct 28 08:32:49.135020 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 2/5] 10.222.0.76 () {64 vars in 1282 bytes} [Thu Oct 28 08:32:49 2021] POST /compute/v2.1/flavors => generated 407 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:32:49.399320 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-9f187b1e-911b-4566-b1c1-898f5620e643 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:49.403100 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:32:49.403100 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Oct 28 08:32:49.463430 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-9f187b1e-911b-4566-b1c1-898f5620e643 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.317374 Oct 28 08:32:49.466705 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 4/6] 10.222.0.76 () {64 vars in 1335 bytes} [Thu Oct 28 08:32:49 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:32:51.846630 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-d774c6de-b867-4941-8c94-accd241bc448 admin admin] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:32:51.847848 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-d774c6de-b867-4941-8c94-accd241bc448 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002302 Oct 28 08:32:51.848339 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 3/7] 10.222.0.76 () {54 vars in 930 bytes} [Thu Oct 28 08:32:51 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:32:51.973006 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-751c28d4-40b0-4099-8907-44bada9acbe7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "disk": 5, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds512M"}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:51.994224 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:32:51.994224 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Oct 28 08:32:52.020927 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-751c28d4-40b0-4099-8907-44bada9acbe7 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.164898 Oct 28 08:32:52.022189 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 5/8] 10.222.0.76 () {64 vars in 1282 bytes} [Thu Oct 28 08:32:51 2021] POST /compute/v2.1/flavors => generated 404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:32:52.035172 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-c15ed134-2528-4b67-80d3-fd162805d265 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:52.036571 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:32:52.036571 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Oct 28 08:32:52.071122 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-c15ed134-2528-4b67-80d3-fd162805d265 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040429 Oct 28 08:32:52.074575 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 4/9] 10.222.0.76 () {64 vars in 1335 bytes} [Thu Oct 28 08:32:52 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:32:54.432907 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-751c28d4-40b0-4099-8907-44bada9acbe7 admin admin] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:32:54.434126 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-751c28d4-40b0-4099-8907-44bada9acbe7 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001668 Oct 28 08:32:54.434668 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 6/10] 10.222.0.76 () {54 vars in 930 bytes} [Thu Oct 28 08:32:54 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:32:54.498224 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-a35ee60e-8a35-429f-baef-9680f0d15c4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 1024, "rxtx_factor": 1.0, "name": "ds1G", "vcpus": 1, "swap": 0}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:54.517577 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-a35ee60e-8a35-429f-baef-9680f0d15c4f admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074994 Oct 28 08:32:54.518197 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 5/11] 10.222.0.76 () {64 vars in 1282 bytes} [Thu Oct 28 08:32:54 2021] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:32:54.530641 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-15627a6b-f0e0-4950-b91e-5977ab03c936 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:54.555770 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-15627a6b-f0e0-4950-b91e-5977ab03c936 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028599 Oct 28 08:32:54.556483 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 7/12] 10.222.0.76 () {64 vars in 1335 bytes} [Thu Oct 28 08:32:54 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:32:56.942364 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-a35ee60e-8a35-429f-baef-9680f0d15c4f admin admin] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:32:56.943465 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-a35ee60e-8a35-429f-baef-9680f0d15c4f admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Oct 28 08:32:56.944258 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 6/13] 10.222.0.76 () {54 vars in 930 bytes} [Thu Oct 28 08:32:56 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:32:57.012642 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-1fe5db91-a346-4eb2-a213-5f21fbd8ba95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "vcpus": 2, "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "disk": 10, "swap": 0, "name": "ds2G"}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:57.032322 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-1fe5db91-a346-4eb2-a213-5f21fbd8ba95 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077365 Oct 28 08:32:57.034261 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 8/14] 10.222.0.76 () {64 vars in 1282 bytes} [Thu Oct 28 08:32:56 2021] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:32:57.049392 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-d8402eab-13b3-4c3a-8ab1-eada8f2bde2e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:57.072417 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-d8402eab-13b3-4c3a-8ab1-eada8f2bde2e admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028952 Oct 28 08:32:57.073007 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 7/15] 10.222.0.76 () {64 vars in 1335 bytes} [Thu Oct 28 08:32:57 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:32:59.507630 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-1fe5db91-a346-4eb2-a213-5f21fbd8ba95 admin admin] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:32:59.509249 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-1fe5db91-a346-4eb2-a213-5f21fbd8ba95 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002032 Oct 28 08:32:59.509653 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 9/16] 10.222.0.76 () {54 vars in 930 bytes} [Thu Oct 28 08:32:59 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:32:59.576590 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-ab794886-090d-4b30-b190-f32c64a1f899 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "id": "d4", "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:59.596818 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-ab794886-090d-4b30-b190-f32c64a1f899 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079531 Oct 28 08:32:59.597659 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 8/17] 10.222.0.76 () {64 vars in 1282 bytes} [Thu Oct 28 08:32:59 2021] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:32:59.610193 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-c96ff97f-d566-49ca-b457-863623f13558 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:32:59.637915 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-c96ff97f-d566-49ca-b457-863623f13558 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031277 Oct 28 08:32:59.639527 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 10/18] 10.222.0.76 () {64 vars in 1335 bytes} [Thu Oct 28 08:32:59 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:33:02.105366 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-ab794886-090d-4b30-b190-f32c64a1f899 admin admin] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:02.106387 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-ab794886-090d-4b30-b190-f32c64a1f899 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Oct 28 08:33:02.106849 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 9/19] 10.222.0.76 () {54 vars in 930 bytes} [Thu Oct 28 08:33:02 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:33:02.167800 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-53c7f2ca-a405-4e40-8345-094a2a5f45e6 admin admin] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:02.192009 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-53c7f2ca-a405-4e40-8345-094a2a5f45e6 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077050 Oct 28 08:33:02.192565 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 11/20] 10.222.0.76 () {60 vars in 1291 bytes} [Thu Oct 28 08:33:02 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:33:04.620431 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-ab794886-090d-4b30-b190-f32c64a1f899 admin admin] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:04.621518 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-ab794886-090d-4b30-b190-f32c64a1f899 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Oct 28 08:33:04.622167 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 10/21] 10.222.0.76 () {54 vars in 930 bytes} [Thu Oct 28 08:33:04 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:33:04.692247 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-64a8876f-7da5-4a80-a566-f6b5a4e87686 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "swap": 0, "id": "1", "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "rxtx_factor": 1.0}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:33:04.714615 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-64a8876f-7da5-4a80-a566-f6b5a4e87686 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.085731 Oct 28 08:33:04.715337 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 12/22] 10.222.0.76 () {64 vars in 1282 bytes} [Thu Oct 28 08:33:04 2021] POST /compute/v2.1/flavors => generated 402 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:33:04.728531 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-9ef4d9e9-aa38-4c09-9437-4a538ea188f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:33:04.754141 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-9ef4d9e9-aa38-4c09-9437-4a538ea188f1 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029359 Oct 28 08:33:04.755285 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 11/23] 10.222.0.76 () {64 vars in 1332 bytes} [Thu Oct 28 08:33:04 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:33:07.127994 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-64a8876f-7da5-4a80-a566-f6b5a4e87686 admin admin] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:07.129354 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-64a8876f-7da5-4a80-a566-f6b5a4e87686 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002082 Oct 28 08:33:07.129915 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 13/24] 10.222.0.76 () {54 vars in 930 bytes} [Thu Oct 28 08:33:07 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:33:07.196778 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-00ddc979-184f-4c1d-88b8-bbf52fd18ba9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 2048, "name": "m1.small", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:33:07.215321 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-00ddc979-184f-4c1d-88b8-bbf52fd18ba9 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078180 Oct 28 08:33:07.215881 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 12/25] 10.222.0.76 () {64 vars in 1282 bytes} [Thu Oct 28 08:33:07 2021] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:33:07.229598 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-3b7220dd-721b-4e18-adb5-243b532931c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:33:07.256403 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-3b7220dd-721b-4e18-adb5-243b532931c6 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030458 Oct 28 08:33:07.257170 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 14/26] 10.222.0.76 () {64 vars in 1332 bytes} [Thu Oct 28 08:33:07 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:33:09.624376 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-00ddc979-184f-4c1d-88b8-bbf52fd18ba9 admin admin] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:09.625566 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-00ddc979-184f-4c1d-88b8-bbf52fd18ba9 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Oct 28 08:33:09.626722 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 13/27] 10.222.0.76 () {54 vars in 930 bytes} [Thu Oct 28 08:33:09 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:33:09.693974 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-f5aca19d-7965-4bf0-8664-f230b20821ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "vcpus": 2, "disk": 40}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:33:09.718156 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-f5aca19d-7965-4bf0-8664-f230b20821ee admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.084127 Oct 28 08:33:09.719086 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 15/28] 10.222.0.76 () {64 vars in 1282 bytes} [Thu Oct 28 08:33:09 2021] POST /compute/v2.1/flavors => generated 406 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:33:09.731709 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b5dc7f90-0023-474d-811b-df47c3853c0b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:33:09.771082 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b5dc7f90-0023-474d-811b-df47c3853c0b admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042901 Oct 28 08:33:09.772036 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 14/29] 10.222.0.76 () {64 vars in 1332 bytes} [Thu Oct 28 08:33:09 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:33:12.263545 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-f5aca19d-7965-4bf0-8664-f230b20821ee admin admin] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:12.265171 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-f5aca19d-7965-4bf0-8664-f230b20821ee admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002156 Oct 28 08:33:12.265575 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 16/30] 10.222.0.76 () {54 vars in 930 bytes} [Thu Oct 28 08:33:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:33:12.341180 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-62ec7321-3d3b-4803-a8dc-439cc0246044 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "disk": 80, "id": "4", "ram": 8192}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:33:12.361147 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-62ec7321-3d3b-4803-a8dc-439cc0246044 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.087466 Oct 28 08:33:12.361701 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 15/31] 10.222.0.76 () {64 vars in 1282 bytes} [Thu Oct 28 08:33:12 2021] POST /compute/v2.1/flavors => generated 405 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:33:12.374578 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-369f1184-d38c-4539-b3b0-51ff5f1f05a4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:33:12.411441 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-369f1184-d38c-4539-b3b0-51ff5f1f05a4 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040433 Oct 28 08:33:12.412025 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 17/32] 10.222.0.76 () {64 vars in 1332 bytes} [Thu Oct 28 08:33:12 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:33:14.855341 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-62ec7321-3d3b-4803-a8dc-439cc0246044 admin admin] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:14.855928 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-62ec7321-3d3b-4803-a8dc-439cc0246044 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001825 Oct 28 08:33:14.856189 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 16/33] 10.222.0.76 () {54 vars in 930 bytes} [Thu Oct 28 08:33:14 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:33:15.013016 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-5bb310f7-e56a-4b76-bccc-4845737c5eb4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "name": "m1.xlarge", "id": "5", "ram": 16384, "disk": 160, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:33:15.037119 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-5bb310f7-e56a-4b76-bccc-4845737c5eb4 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.172659 Oct 28 08:33:15.037769 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 18/34] 10.222.0.76 () {64 vars in 1282 bytes} [Thu Oct 28 08:33:14 2021] POST /compute/v2.1/flavors => generated 408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:33:15.050903 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-4200e3f7-dfa3-4326-8eee-dfe7954c5203 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:33:15.077335 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-4200e3f7-dfa3-4326-8eee-dfe7954c5203 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030994 Oct 28 08:33:15.078318 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 17/35] 10.222.0.76 () {64 vars in 1332 bytes} [Thu Oct 28 08:33:15 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:33:55.626067 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-5bb310f7-e56a-4b76-bccc-4845737c5eb4 admin admin] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:55.627110 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-5bb310f7-e56a-4b76-bccc-4845737c5eb4 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002236 Oct 28 08:33:55.627510 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 19/36] 10.222.0.76 () {54 vars in 930 bytes} [Thu Oct 28 08:33:55 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:33:55.685676 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-97ec23d6-6a46-4425-ba9d-9b915ac403e6 admin admin] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:55.703986 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-97ec23d6-6a46-4425-ba9d-9b915ac403e6 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069408 Oct 28 08:33:55.704523 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 18/37] 10.222.0.76 () {60 vars in 1291 bytes} [Thu Oct 28 08:33:55 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:33:57.236515 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-5bb310f7-e56a-4b76-bccc-4845737c5eb4 admin admin] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:57.237604 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-5bb310f7-e56a-4b76-bccc-4845737c5eb4 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002103 Oct 28 08:33:57.238273 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 20/38] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Oct 28 08:33:57 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:33:57.435287 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-511dc61e-609a-4636-9596-b150ee818a4c admin admin] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:57.441401 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-511dc61e-609a-4636-9596-b150ee818a4c admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 08:33:57.441972 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-511dc61e-609a-4636-9596-b150ee818a4c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:33:57.442802 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-511dc61e-609a-4636-9596-b150ee818a4c admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059929 Oct 28 08:33:57.443318 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 19/39] 10.222.0.76 () {60 vars in 1190 bytes} [Thu Oct 28 08:33:57 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 08:33:57.453000 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-dc23c259-2967-433d-a9bc-8f276db036d9 admin admin] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:57.473773 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-dc23c259-2967-433d-a9bc-8f276db036d9 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024252 Oct 28 08:33:57.474312 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 21/40] 10.222.0.76 () {60 vars in 1210 bytes} [Thu Oct 28 08:33:57 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:33:57.485767 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-90234647-b5e8-498b-895a-5609b9fe34da admin admin] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:57.506968 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-90234647-b5e8-498b-895a-5609b9fe34da admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025689 Oct 28 08:33:57.507509 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 20/41] 10.222.0.76 () {60 vars in 1210 bytes} [Thu Oct 28 08:33:57 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:33:57.517977 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-21e299e7-849c-428e-89ed-7dcf2cde7ef9 admin admin] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:57.523684 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.wsgi [None req-21e299e7-849c-428e-89ed-7dcf2cde7ef9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 08:33:57.524253 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-21e299e7-849c-428e-89ed-7dcf2cde7ef9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=107292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:33:57.525052 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-21e299e7-849c-428e-89ed-7dcf2cde7ef9 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011012 Oct 28 08:33:57.525573 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 22/42] 10.222.0.76 () {60 vars in 1190 bytes} [Thu Oct 28 08:33:57 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 08:33:58.959203 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-90234647-b5e8-498b-895a-5609b9fe34da admin admin] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:58.960229 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-90234647-b5e8-498b-895a-5609b9fe34da admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Oct 28 08:33:58.960649 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 21/43] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Oct 28 08:33:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:33:59.154796 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-6e3340aa-c068-4376-a1c4-b8325f876fcd admin admin] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:59.161675 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.wsgi [None req-6e3340aa-c068-4376-a1c4-b8325f876fcd admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 08:33:59.162232 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-6e3340aa-c068-4376-a1c4-b8325f876fcd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=107292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:33:59.163052 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-6e3340aa-c068-4376-a1c4-b8325f876fcd admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059780 Oct 28 08:33:59.163554 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 23/44] 10.222.0.76 () {60 vars in 1190 bytes} [Thu Oct 28 08:33:59 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 08:33:59.174063 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b78366ac-2a39-442d-9b33-abbba6b3a026 admin admin] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:59.187220 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b78366ac-2a39-442d-9b33-abbba6b3a026 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017422 Oct 28 08:33:59.187828 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 22/45] 10.222.0.76 () {60 vars in 1210 bytes} [Thu Oct 28 08:33:59 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:33:59.197884 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-66c565b5-35ce-4b23-b94b-73ef8cb3e79f admin admin] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:59.212149 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-66c565b5-35ce-4b23-b94b-73ef8cb3e79f admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017730 Oct 28 08:33:59.212679 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 24/46] 10.222.0.76 () {60 vars in 1210 bytes} [Thu Oct 28 08:33:59 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:33:59.223279 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-deac937c-5107-4526-8d69-3aa13920c9ee admin admin] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:33:59.228781 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-deac937c-5107-4526-8d69-3aa13920c9ee admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 08:33:59.229354 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-deac937c-5107-4526-8d69-3aa13920c9ee admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:33:59.230140 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-deac937c-5107-4526-8d69-3aa13920c9ee admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010975 Oct 28 08:33:59.230668 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 23/47] 10.222.0.76 () {60 vars in 1190 bytes} [Thu Oct 28 08:33:59 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 28 08:34:00.677924 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-66c565b5-35ce-4b23-b94b-73ef8cb3e79f admin admin] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:34:00.678973 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-66c565b5-35ce-4b23-b94b-73ef8cb3e79f admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 28 08:34:00.679372 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 25/48] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Oct 28 08:34:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:34:00.873529 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-aea57eb1-d6c7-4512-9a77-26b0264c0365 admin admin] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:34:00.879644 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-aea57eb1-d6c7-4512-9a77-26b0264c0365 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 08:34:00.880243 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-aea57eb1-d6c7-4512-9a77-26b0264c0365 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:34:00.881134 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-aea57eb1-d6c7-4512-9a77-26b0264c0365 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061602 Oct 28 08:34:00.881561 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 24/49] 10.222.0.76 () {60 vars in 1193 bytes} [Thu Oct 28 08:34:00 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 08:34:00.892263 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-947942f1-5766-49d1-b00c-3c52d2cc542a admin admin] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:34:00.910244 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-947942f1-5766-49d1-b00c-3c52d2cc542a admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022213 Oct 28 08:34:00.910835 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 26/50] 10.222.0.76 () {60 vars in 1210 bytes} [Thu Oct 28 08:34:00 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:34:00.922572 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-fe779e02-ed43-4c87-8274-6541841b1b42 admin admin] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:34:00.936694 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-fe779e02-ed43-4c87-8274-6541841b1b42 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017770 Oct 28 08:34:00.937252 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 25/51] 10.222.0.76 () {60 vars in 1210 bytes} [Thu Oct 28 08:34:00 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:34:00.947421 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-6fde3a86-f0d7-48cf-aeba-ae22c66529b2 admin admin] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:34:00.952853 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.wsgi [None req-6fde3a86-f0d7-48cf-aeba-ae22c66529b2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 08:34:00.954035 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-6fde3a86-f0d7-48cf-aeba-ae22c66529b2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=107292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:34:00.954858 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-6fde3a86-f0d7-48cf-aeba-ae22c66529b2 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011019 Oct 28 08:34:00.955373 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 27/52] 10.222.0.76 () {60 vars in 1193 bytes} [Thu Oct 28 08:34:00 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 08:34:02.472319 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-fe779e02-ed43-4c87-8274-6541841b1b42 admin admin] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:34:02.473402 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-fe779e02-ed43-4c87-8274-6541841b1b42 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Oct 28 08:34:02.473799 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 26/53] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Oct 28 08:34:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:34:02.670761 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-b45d579f-1ff2-484a-83a0-1dab41fb62f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:34:02.689582 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-b45d579f-1ff2-484a-83a0-1dab41fb62f0 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.073243 Oct 28 08:34:02.690031 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 28/54] 10.222.0.76 () {64 vars in 1235 bytes} [Thu Oct 28 08:34:02 2021] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:34:04.159256 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-fe779e02-ed43-4c87-8274-6541841b1b42 admin admin] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:34:04.160277 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-fe779e02-ed43-4c87-8274-6541841b1b42 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Oct 28 08:34:04.160669 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 27/55] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Oct 28 08:34:04 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:34:04.362191 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-acbda8a6-f7dc-4531-8958-0df2fd4baeba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:34:04.381841 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-acbda8a6-f7dc-4531-8958-0df2fd4baeba admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.074071 Oct 28 08:34:04.382403 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 29/56] 10.222.0.76 () {64 vars in 1235 bytes} [Thu Oct 28 08:34:04 2021] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:34:05.838986 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-fe779e02-ed43-4c87-8274-6541841b1b42 admin admin] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:34:05.839986 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-fe779e02-ed43-4c87-8274-6541841b1b42 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 28 08:34:05.840378 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 28/57] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Oct 28 08:34:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:34:06.037522 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-4a897540-32b8-4f79-a941-d4d7b5904efc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:34:06.059289 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-4a897540-32b8-4f79-a941-d4d7b5904efc admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.075689 Oct 28 08:34:06.059837 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 30/58] 10.222.0.76 () {64 vars in 1235 bytes} [Thu Oct 28 08:34:05 2021] POST /compute/v2.1/flavors => generated 407 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:34:07.540206 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-fe779e02-ed43-4c87-8274-6541841b1b42 admin admin] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:34:07.541218 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-fe779e02-ed43-4c87-8274-6541841b1b42 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Oct 28 08:34:07.541655 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 29/59] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Oct 28 08:34:07 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:34:07.750126 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-9100d5c0-a358-43f4-8882-80ae229f0cc7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:34:07.769443 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-9100d5c0-a358-43f4-8882-80ae229f0cc7 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.077230 Oct 28 08:34:07.769989 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 31/60] 10.222.0.76 () {64 vars in 1235 bytes} [Thu Oct 28 08:34:07 2021] POST /compute/v2.1/flavors => generated 409 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:34:09.283632 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-fe779e02-ed43-4c87-8274-6541841b1b42 admin admin] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:34:09.284641 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-fe779e02-ed43-4c87-8274-6541841b1b42 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 28 08:34:09.285039 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 30/61] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Oct 28 08:34:09 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:34:09.476596 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-037b72cd-5802-4741-85ef-dc7aa4269a72 admin admin] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:34:09.495608 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-037b72cd-5802-4741-85ef-dc7aa4269a72 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070419 Oct 28 08:34:09.496156 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 32/62] 10.222.0.76 () {60 vars in 1202 bytes} [Thu Oct 28 08:34:09 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:34:56.946851 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-fe779e02-ed43-4c87-8274-6541841b1b42 admin admin] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:34:56.947905 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-fe779e02-ed43-4c87-8274-6541841b1b42 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Oct 28 08:34:56.948314 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 31/63] 10.222.0.76 () {54 vars in 930 bytes} [Thu Oct 28 08:34:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:34:57.008850 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-47cccd85-c931-4f9c-9691-4cb6d23f7d55 admin admin] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:34:57.027808 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-47cccd85-c931-4f9c-9691-4cb6d23f7d55 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072665 Oct 28 08:34:57.028344 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 33/64] 10.222.0.76 () {60 vars in 1291 bytes} [Thu Oct 28 08:34:56 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:34:57.050691 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-96d81b45-4458-42b1-b736-0ddc90bb289d admin admin] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:34:57.058278 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-96d81b45-4458-42b1-b736-0ddc90bb289d admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011154 Oct 28 08:34:57.059113 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 32/65] 10.222.0.76 () {60 vars in 1282 bytes} [Thu Oct 28 08:34:57 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:34:57.071263 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-8529d096-1a2f-491a-8d5b-c26244eedd9d admin admin] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:34:57.079076 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-8529d096-1a2f-491a-8d5b-c26244eedd9d admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011352 Oct 28 08:34:57.079609 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 34/66] 10.222.0.76 () {60 vars in 1285 bytes} [Thu Oct 28 08:34:57 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:34:57.091735 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-7b56216b-af07-4122-b7c8-9be759cac4e8 admin admin] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:34:57.100071 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-7b56216b-af07-4122-b7c8-9be759cac4e8 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012006 Oct 28 08:34:57.100609 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 33/67] 10.222.0.76 () {60 vars in 1285 bytes} [Thu Oct 28 08:34:57 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:34:57.114019 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-dd9137fb-ae4f-40ed-9696-a0ee9089b376 admin admin] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:34:57.121758 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-dd9137fb-ae4f-40ed-9696-a0ee9089b376 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011279 Oct 28 08:34:57.122274 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 35/68] 10.222.0.76 () {60 vars in 1282 bytes} [Thu Oct 28 08:34:57 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:36:18.709822 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-37e1c6f0-2d52-429b-b56b-883a60cd10b7 tempest-verify_tempest_config-669832926 tempest-verify_tempest_config-669832926-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:36:18.712019 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-37e1c6f0-2d52-429b-b56b-883a60cd10b7 tempest-verify_tempest_config-669832926 tempest-verify_tempest_config-669832926-project] 10.222.0.76 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.116354 Oct 28 08:36:18.712561 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 34/69] 10.222.0.76 () {58 vars in 1133 bytes} [Thu Oct 28 08:36:18 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:37:51.805342 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-dd9137fb-ae4f-40ed-9696-a0ee9089b376 admin admin] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:37:51.806397 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-dd9137fb-ae4f-40ed-9696-a0ee9089b376 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 28 08:37:51.806820 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 36/70] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Oct 28 08:37:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:37:52.082935 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-f139b8c9-1047-4702-9043-54caf20bb6fa admin admin] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:37:52.084143 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:37:52.084143 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Oct 28 08:37:52.085849 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f139b8c9-1047-4702-9043-54caf20bb6fa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:37:52.086299 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f139b8c9-1047-4702-9043-54caf20bb6fa admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:37:52.087123 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f139b8c9-1047-4702-9043-54caf20bb6fa admin admin] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:37:52.087552 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f139b8c9-1047-4702-9043-54caf20bb6fa admin admin] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:37:52.124810 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-f139b8c9-1047-4702-9043-54caf20bb6fa admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.173081 Oct 28 08:37:52.125403 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 35/71] 10.222.0.76 () {60 vars in 1193 bytes} [Thu Oct 28 08:37:51 2021] GET /compute/v2.1/os-services => generated 791 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:37:53.607576 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-dd9137fb-ae4f-40ed-9696-a0ee9089b376 admin admin] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:37:53.608642 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-dd9137fb-ae4f-40ed-9696-a0ee9089b376 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Oct 28 08:37:53.609121 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 37/72] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Oct 28 08:37:53 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:37:53.809135 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-a7263d64-24df-417c-8137-a9fc4ecd016f admin admin] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:37:53.810380 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:37:53.810380 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Oct 28 08:37:53.811925 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a7263d64-24df-417c-8137-a9fc4ecd016f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:37:53.812417 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a7263d64-24df-417c-8137-a9fc4ecd016f admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:37:53.813160 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a7263d64-24df-417c-8137-a9fc4ecd016f admin admin] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:37:53.813584 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a7263d64-24df-417c-8137-a9fc4ecd016f admin admin] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:37:53.833352 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-a7263d64-24df-417c-8137-a9fc4ecd016f admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079643 Oct 28 08:37:53.833939 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 36/73] 10.222.0.76 () {60 vars in 1193 bytes} [Thu Oct 28 08:37:53 2021] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:38:05.823963 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-dd9137fb-ae4f-40ed-9696-a0ee9089b376 admin admin] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:38:05.824968 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-dd9137fb-ae4f-40ed-9696-a0ee9089b376 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Oct 28 08:38:05.825366 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 38/74] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Oct 28 08:38:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:38:06.027662 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-95255f22-eb17-477c-b393-0d7067b57f57 admin admin] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:38:06.028830 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:38:06.028830 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Oct 28 08:38:06.030406 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-95255f22-eb17-477c-b393-0d7067b57f57 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:38:06.030876 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-95255f22-eb17-477c-b393-0d7067b57f57 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:38:06.031668 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-95255f22-eb17-477c-b393-0d7067b57f57 admin admin] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:38:06.032104 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-95255f22-eb17-477c-b393-0d7067b57f57 admin admin] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:38:06.057557 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-95255f22-eb17-477c-b393-0d7067b57f57 admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086855 Oct 28 08:38:06.058144 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 37/75] 10.222.0.76 () {60 vars in 1193 bytes} [Thu Oct 28 08:38:05 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:38:07.539387 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-dd9137fb-ae4f-40ed-9696-a0ee9089b376 admin admin] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:38:07.540405 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-dd9137fb-ae4f-40ed-9696-a0ee9089b376 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Oct 28 08:38:07.540810 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 39/76] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Oct 28 08:38:07 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:38:07.751530 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-39b69dc7-1a6a-40bb-967a-0694f649bfba admin admin] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:38:07.753547 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:38:07.753547 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Oct 28 08:38:07.755285 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-39b69dc7-1a6a-40bb-967a-0694f649bfba admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:38:07.755870 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-39b69dc7-1a6a-40bb-967a-0694f649bfba admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:38:07.756877 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-39b69dc7-1a6a-40bb-967a-0694f649bfba admin admin] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:38:07.757435 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-39b69dc7-1a6a-40bb-967a-0694f649bfba admin admin] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:38:07.781418 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-39b69dc7-1a6a-40bb-967a-0694f649bfba admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087615 Oct 28 08:38:07.782021 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 38/77] 10.222.0.76 () {60 vars in 1193 bytes} [Thu Oct 28 08:38:07 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:39:09.115381 dv-cinder-815659-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 28 08:39:09.115931 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: Thu Oct 28 08:39:09 2021 - graceful shutdown triggered... Oct 28 08:39:09.116395 dv-cinder-815659-2-iscsi devstack@n-api.service[107292]: Gracefully killing worker 1 (pid: 107292)... Oct 28 08:39:09.116772 dv-cinder-815659-2-iscsi devstack@n-api.service[107293]: Gracefully killing worker 2 (pid: 107293)... Oct 28 08:39:10.116833 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: worker 1 buried after 1 seconds Oct 28 08:39:10.117306 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: worker 2 buried after 1 seconds Oct 28 08:39:10.117306 dv-cinder-815659-2-iscsi devstack@n-api.service[107291]: goodbye to uWSGI. Oct 28 08:39:10.118414 dv-cinder-815659-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 28 08:39:10.118981 dv-cinder-815659-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 28 08:39:10.121838 dv-cinder-815659-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 08:39:10.132009 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 08:39:10.134630 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 28 08:39:10 2021] *** Oct 28 08:39:10.134788 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 08:39:10.134904 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 08:39:10.134999 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: nodename: dv-cinder-815659-2-iscsi Oct 28 08:39:10.135108 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: machine: x86_64 Oct 28 08:39:10.135217 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: clock source: unix Oct 28 08:39:10.135330 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: pcre jit disabled Oct 28 08:39:10.135441 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: detected number of CPU cores: 4 Oct 28 08:39:10.135562 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: current working directory: / Oct 28 08:39:10.135671 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: detected binary path: /usr/bin/uwsgi-core Oct 28 08:39:10.135799 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: your processes number limit is 47680 Oct 28 08:39:10.135799 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: your memory page size is 4096 bytes Oct 28 08:39:10.135799 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: detected max file descriptor number: 2048 Oct 28 08:39:10.135799 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: lock engine: pthread robust mutexes Oct 28 08:39:10.136128 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: thunder lock: enabled Oct 28 08:39:10.136128 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 08:39:10.136273 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 28 08:39:10.182219 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: Python main interpreter initialized at 0x555e782849c0 Oct 28 08:39:10.182219 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: python threads support enabled Oct 28 08:39:10.182219 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: your server socket listen backlog is limited to 100 connections Oct 28 08:39:10.182219 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: your mercy for graceful operations on workers is 90 seconds Oct 28 08:39:10.182760 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 08:39:10.182760 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: *** Operational MODE: preforking *** Oct 28 08:39:10.182964 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: *** uWSGI is running in multiple interpreter mode *** Oct 28 08:39:10.182964 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: spawned uWSGI master process (pid: 122242) Oct 28 08:39:10.183177 dv-cinder-815659-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 28 08:39:10.183749 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: spawned uWSGI worker 1 (pid: 122256, cores: 1) Oct 28 08:39:10.184098 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: spawned uWSGI worker 2 (pid: 122257, cores: 1) Oct 28 08:39:10.184307 dv-cinder-815659-2-iscsi devstack@n-api.service[122242]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 08:39:12.007819 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 08:39:12.007819 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: from cryptography.utils import int_from_bytes Oct 28 08:39:12.008484 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 08:39:12.008484 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: from cryptography.utils import int_from_bytes Oct 28 08:39:12.018688 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 08:39:12.018688 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: from cryptography.utils import int_from_bytes Oct 28 08:39:12.019476 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 08:39:12.019476 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: from cryptography.utils import int_from_bytes Oct 28 08:39:14.573125 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 08:39:14.573711 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 08:39:14.573998 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 08:39:14.574219 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 08:39:14.574477 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 08:39:14.574896 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.575224 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.575546 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.575863 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.576190 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.576499 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.576824 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.577142 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.577472 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.577732 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.578051 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.578370 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815659-2-iscsi {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.578716 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.579026 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.579352 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.579671 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.579958 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.580283 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.581167 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.581678 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.583170 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.583170 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.583170 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.583575 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.583845 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.584152 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.584465 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.584779 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.585111 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.585412 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.585816 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815659-2-iscsi {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.586131 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.586454 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.586789 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.587211 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.587524 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.587836 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.588150 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.588465 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.588783 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.589105 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.589415 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.589740 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.590054 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.590359 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.590696 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.591007 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.591327 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.591631 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.591945 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.592193 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.592498 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.592818 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.593137 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.593456 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.593707 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.593957 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.594273 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.594615 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.595039 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.595222 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.595509 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.595813 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.596153 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.596460 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.596765 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.597070 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.597386 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.597701 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.597858 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 08:39:14.598332 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.598480 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 08:39:14.598696 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.598854 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 08:39:14.599011 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.599177 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 08:39:14.599343 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.599498 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 08:39:14.599658 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.599806 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.599964 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.600124 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.600282 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.600438 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.600599 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.600795 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.600955 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.601103 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.601529 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.601691 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.601845 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.601845 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.602150 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.602308 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.602462 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.602655 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.602804 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.602804 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.603110 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.603264 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.603420 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.603576 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815659-2-iscsi {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.603729 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.603729 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.605319 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.605511 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.605680 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.605836 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.605989 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.606135 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.606281 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.606434 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.606649 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.606798 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.606952 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.607109 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.607271 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.607425 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.607425 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.607734 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.608091 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.608245 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.608400 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.608563 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.608721 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.608875 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.609021 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.609166 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.609318 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.609489 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.609637 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.609790 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.609942 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.610097 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.610254 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.610415 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.610592 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.610755 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.610910 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.611063 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.611219 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.611373 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815659-2-iscsi {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.611531 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.611906 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.612065 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.612228 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.612384 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.612539 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.612685 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.612685 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.612979 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.613128 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.613280 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.613426 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.613587 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.613746 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.613900 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.614046 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.614192 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.614347 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.614539 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.614539 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.615469 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.615633 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.615782 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.615936 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.616154 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.616434 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.616588 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.616734 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.616881 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.617037 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.617191 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.617345 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.617492 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.617638 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.617797 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.617957 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.618204 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.618364 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.618569 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.618723 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.618892 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.619041 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.619195 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.619341 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.619502 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.619656 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.619893 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.620049 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.620208 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.620365 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.620534 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.620697 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.620846 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.620997 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.621144 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.621290 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.621492 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.621658 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.621811 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.621956 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.622109 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.622264 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.622428 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.622616 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.622765 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.622912 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.622912 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.623204 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.623352 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.623507 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.623659 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.623815 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.623970 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.624117 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.624275 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.624448 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.624595 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.624764 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.625667 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.625837 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.625996 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.626145 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.626145 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.626429 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.626429 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.626800 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.626959 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.627118 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.627758 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.627921 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.628076 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.628257 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.628641 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.628839 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.628991 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.629146 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.629301 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.629467 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.629622 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.629777 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.629936 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.630082 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.630237 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.630398 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.630563 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.630728 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.630874 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.631026 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.631179 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.631334 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.631488 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.631488 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.631784 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.631941 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.632097 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.632244 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.632399 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.632555 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.632710 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.632865 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.633024 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.633178 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.633330 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.633483 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.633629 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.633774 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.633940 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.634087 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.634239 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.634386 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.634594 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.634757 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.634915 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.635192 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.635979 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.636136 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.636283 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.636430 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.636603 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.636764 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.636912 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.637068 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.637222 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.637383 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.637537 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.637691 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.637838 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.637992 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.638153 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.638309 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.638463 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.638666 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.638913 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.639073 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.639233 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.639388 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.639541 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.639695 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.639847 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.640005 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.640152 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.640305 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.640451 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.640610 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.640769 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.640924 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.641070 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.641223 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.641383 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.641542 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.641698 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.641850 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.642004 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.642150 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.642295 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.642448 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.642694 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.643665 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.644004 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.644254 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.644409 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.644556 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.644723 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.644879 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.645032 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.645196 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.645442 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.646185 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.646185 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.646628 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.646791 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.646938 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.647091 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.647253 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.647407 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.647563 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.647720 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.647866 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.648010 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.648168 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.648314 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.648766 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.649055 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.649218 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.649374 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.649539 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.649691 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.649845 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.649992 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:39:14.650147 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.650303 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.650458 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.650648 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.650884 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.651040 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.651213 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.651411 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.651569 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.651569 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.651848 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.651995 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.652140 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.652298 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.652443 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.652596 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.652751 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.652897 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.653051 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.653217 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.653217 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.653511 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.653658 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.653810 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.653970 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.654117 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.654270 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.654425 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.654608 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.654764 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.654920 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.655084 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.655232 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.655402 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.655629 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.656281 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.656467 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.656711 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.656863 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.657017 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.657017 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.657296 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.657455 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.657603 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.657767 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.657915 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.658061 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.658224 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.658380 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.658579 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.658579 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.658863 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.659029 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.659266 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.659418 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.659580 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.659736 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.659902 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.660058 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.660214 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.660361 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.660506 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.660650 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.660803 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.660958 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.661119 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.661273 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.661431 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.661585 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.661738 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.661908 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.662055 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.662210 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.662363 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.662557 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.662721 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.662882 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.663029 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.663175 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.663328 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.663481 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.663635 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.663801 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.663948 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.664093 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.664239 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.664385 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.664537 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.664693 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.664839 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.664992 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.665146 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.665301 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.665462 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.665627 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.665892 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.666765 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.667035 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.667188 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.667349 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.667507 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.667659 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.667805 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.667951 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.668096 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.668249 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.668397 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.668543 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.668708 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.668855 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.669009 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.669165 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.669420 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.669573 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.669727 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.669874 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.670019 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.670177 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.670332 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.670477 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.670717 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.670876 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.671035 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.671183 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.671327 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.671478 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.671632 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.671784 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.671943 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.672102 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.672258 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.672404 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.672557 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.672714 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.672875 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.673029 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.673176 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.673321 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.673473 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.673633 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.673794 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.673940 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.674085 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.674382 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.674550 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.674718 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.674885 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.675032 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.675187 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.675341 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.675496 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.675733 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.675909 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.676243 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.676739 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.677015 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.677262 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.677423 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.677571 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.677728 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.677883 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.678037 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.678191 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.678408 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.678588 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.678741 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.678894 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.679042 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.679198 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.679358 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.679604 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.679762 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.679936 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.680099 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.680267 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.680420 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.680580 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.680742 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.680896 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.681049 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.681211 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.681516 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.681671 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.681823 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.681997 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.682161 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.682324 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.682477 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.682710 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.682873 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.683034 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.683198 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.683353 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.683505 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.683724 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.683882 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.684041 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.684214 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.684368 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.684368 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.684665 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.684818 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.684969 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.685130 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.685291 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.685443 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.685594 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.685753 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.685915 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.685915 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.686389 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.686841 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.687033 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.687302 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.687558 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.687717 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.687878 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.688040 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.688203 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.688358 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.688519 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.688680 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.688680 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.688982 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.689143 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.689313 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.689477 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.690233 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.690408 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.690587 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.690744 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.690897 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.691062 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.691216 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.691367 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.691541 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.691703 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.691866 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.692026 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.692179 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.692330 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.692489 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.692659 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.692821 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.692974 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.693133 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.693285 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.693445 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.693611 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.693784 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.693784 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.694076 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.694235 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.694387 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.694571 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.694747 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.694928 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.695217 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.695377 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.695529 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.695689 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.695864 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.696018 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.696177 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.696519 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.696971 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.697146 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.697319 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.697599 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.697857 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.698030 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.698185 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.698339 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.698519 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.698691 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.698858 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.699021 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.699188 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.699350 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.699510 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.699694 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.699944 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.700112 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.700273 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.700427 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.700587 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.700740 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.700921 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.701078 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.701231 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.701390 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.701542 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.701694 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.701860 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.702021 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.702174 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.702326 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.702477 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.702695 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.702879 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.703043 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.703203 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.703363 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.703516 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.703677 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.703830 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.703990 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.704144 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.704303 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.704455 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.704455 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.704912 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.704912 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.705484 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.705484 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.706318 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.706318 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.706318 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.707502 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.707778 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.708058 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.708221 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.708388 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.708549 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.708703 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.708868 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.708868 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.709166 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.709324 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.709483 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.709653 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.709816 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.710066 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.710239 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.710403 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.710586 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.710753 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.710907 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.711072 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.711308 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.711473 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.711634 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.711795 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.711795 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.712095 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.712256 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.712417 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.712581 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.712742 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.712902 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.713076 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.713230 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.713390 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.713553 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.713714 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.713874 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.714036 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.714198 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.714350 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.714529 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.714699 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.714859 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.715024 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.715191 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.715344 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.715590 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.715750 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.715904 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.716067 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.716298 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.716455 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.716616 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.716771 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.716956 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.716956 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.717732 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.718034 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.718282 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.718441 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.718715 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.718880 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.719033 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.719193 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.719193 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.719496 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.719703 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.719873 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.720044 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.720280 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.720450 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.720612 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.720774 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.720936 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.721170 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.721326 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.721490 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.721653 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.721952 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.721952 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.722254 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.722254 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.722601 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.722768 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.722929 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.722929 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.723221 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.723379 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.723540 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.723540 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.723849 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.724010 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.724164 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.724324 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.724478 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.724650 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.724805 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.724805 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.725112 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.725381 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.725591 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.725830 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.726000 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.726156 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.726606 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.726767 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.726920 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.727097 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.727621 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.727791 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.727955 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.728213 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.728213 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.728213 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.728766 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.728964 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.729136 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.729292 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.729444 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.729611 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.729775 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.729954 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.730115 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.730286 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.730541 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.730704 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.730858 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.731024 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.731185 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.731349 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.731503 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.731656 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.731807 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.731993 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.732155 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.732309 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.732462 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.732621 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.732783 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.732944 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.733097 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.733255 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.733408 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.733562 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.733562 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.733865 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.734041 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.734195 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.734355 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.734570 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.734742 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.734897 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.735056 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.735209 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.735368 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.735522 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.735683 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.735860 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.736086 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.736255 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.736409 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.736576 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.737269 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.738062 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.738245 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.738527 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.738790 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.738961 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.738961 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.739264 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.739416 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.739576 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.739742 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.739905 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.740058 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.740210 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.740389 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.740735 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.740735 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.741060 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.741215 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.741367 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.741527 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.741680 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.741842 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.742016 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.742172 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.742324 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.742484 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.742732 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.742899 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.743053 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.743205 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.743357 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.743509 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.743661 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.743893 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.744077 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.744232 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.744398 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.744561 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.745553 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.745715 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.745869 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.746022 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.746282 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.746451 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.746679 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.746845 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.747020 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.747184 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.747352 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.747559 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.748080 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.748080 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.748534 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.748794 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.748964 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.748964 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.749375 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.749375 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.749682 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.749863 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.750018 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.750178 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.750345 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.750524 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.750710 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.750961 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.751128 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.751292 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.751494 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.751653 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.751815 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.751978 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.752145 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.752369 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.753021 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.753175 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.753336 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.753505 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.753666 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.753828 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.753982 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.754134 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.754287 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.754454 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.754648 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.754826 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.754983 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.755136 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.755297 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.755297 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.755588 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.755749 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.755902 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.755902 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.756214 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.756473 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.756634 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.756808 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.756974 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.757361 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.757535 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.757698 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.758204 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.758360 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.758748 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.759003 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.759159 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.759284 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.759536 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.759632 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.759714 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.759800 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.759945 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.759945 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.760117 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.760203 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.760286 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.760385 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.760472 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.760556 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.760639 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.760722 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.760805 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.760900 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.761056 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.761154 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.761246 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.761338 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.761430 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.761525 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.761611 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.761694 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.761778 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.761869 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.761962 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.762055 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.762140 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.762223 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.762306 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.762397 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.762553 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.762645 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.762730 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.762813 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.762895 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.762976 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.763073 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.763167 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.763258 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.763350 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.763441 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.763532 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.763625 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.763711 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.763799 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.763884 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.763967 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.764062 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.764147 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.764230 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.764312 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.764394 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.764476 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.764572 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.764658 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.764658 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.764818 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.764903 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.764995 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.765093 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.765179 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.765179 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.765330 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.765413 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.765503 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.765596 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.765688 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.765780 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.765864 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.765960 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.766057 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.766155 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.766241 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.766332 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.766423 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.766613 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.766613 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.766790 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.766881 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.766972 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.767069 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.767162 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.767254 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.767339 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.767429 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.767513 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.767605 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.767697 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.767782 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.767906 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.768072 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.768355 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.768467 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.768563 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.768649 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.768748 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.768836 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.768921 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.769179 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.769179 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.769348 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.769440 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.769539 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.769638 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.769724 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.769814 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.769899 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.769982 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.769982 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.769982 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.769982 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.770297 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.770381 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.770472 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.770586 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.770677 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.770751 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.770829 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.770914 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.770914 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.771071 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.771164 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.771252 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.771339 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.771423 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.771513 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.771605 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.771690 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.771773 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.771773 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.771931 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.772021 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.772117 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.772202 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.772291 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.772382 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.772479 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.772570 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.772662 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.772747 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.772837 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.772921 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.773010 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.773094 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.773189 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.773282 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.773367 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.773367 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.773520 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.773601 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.773674 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.773744 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.773820 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.773891 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.773967 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.774047 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.774119 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.774195 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.774267 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.774343 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.774415 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.774560 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.774642 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.774713 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.774796 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.774869 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.774953 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.775025 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.775104 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.775182 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.775253 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.775329 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.775408 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.775479 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.775549 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.775626 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.775704 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.775775 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.775854 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.775925 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.776095 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.776195 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.776281 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.776376 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.776475 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.776561 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.776639 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.776710 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.776780 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.776876 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.776978 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.777053 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.777123 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.777123 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.777273 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.777366 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.777440 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.777524 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.777616 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.777707 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.777800 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.777893 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.777978 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.778067 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.778147 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.778225 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.778460 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.778578 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.778578 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.778722 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.778794 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.778864 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.778948 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.779021 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.779106 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.779352 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.779441 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.779512 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.779512 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.779661 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.779733 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.779802 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.779879 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.779958 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.780036 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.780113 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.780185 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.780255 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.780323 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.780401 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.780479 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.780479 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.780614 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.780683 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.780752 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.780834 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.780913 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.780986 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.781055 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.781131 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.781210 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.781331 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.781433 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.781507 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.781584 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.781655 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.781733 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.781805 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.781874 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.781874 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.782009 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.782088 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.782171 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.782243 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.782323 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.782323 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.782323 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.782323 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.782611 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.782686 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.782756 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.782832 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.782910 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.782980 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.783063 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.783135 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.783210 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.783294 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.783371 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.783464 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.783790 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.783864 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.783945 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.784017 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.784086 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.784164 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.784164 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.784352 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.784484 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.784558 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.784629 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.784711 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.784783 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.784852 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.784922 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.784999 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.785078 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.785150 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.785220 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.785289 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.785366 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.785443 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.785523 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.785523 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.785657 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.785735 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.785806 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.785882 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.785962 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.786033 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.786103 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.786191 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.789074 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.789193 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.789706 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.789890 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.789971 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.790052 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.790149 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.790237 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.790317 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.790390 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.790390 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.790390 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.790598 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.790685 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.790685 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.790685 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.790685 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.790685 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.790685 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.790685 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.791208 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.791280 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.791601 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.791948 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.792288 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.792598 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.792912 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.793220 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.793544 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.793862 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.794177 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.794488 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.794822 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.795134 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.795447 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.795755 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.796067 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.796378 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.796719 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.797040 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.797358 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.797672 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.797988 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.798299 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.799838 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.800041 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.800188 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.800279 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.800372 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.800450 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.800523 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.800523 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.800653 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.800735 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.800815 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.801004 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.801098 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.801379 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.801570 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.801751 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.801918 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.802084 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.802240 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.802402 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.802683 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.802960 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.803180 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.803382 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.803542 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.803815 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.804016 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.804177 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.804331 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.804518 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.804703 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.804866 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.805098 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.805273 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.805580 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.805746 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.805940 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.806114 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.806114 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.806907 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.806907 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.807215 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.807378 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.807547 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.807547 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.807874 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.808040 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.808203 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.808357 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.808520 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.808682 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.809052 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.809213 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.809367 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.809536 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.809697 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.809851 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.810024 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.810258 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.810451 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.813716 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.813716 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.813716 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.813716 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.814877 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.814877 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.815981 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.816150 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.816546 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.817402 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.817590 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.817590 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.817900 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.818063 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.818217 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.818488 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.818746 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.818934 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.819203 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.819417 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.819693 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.819863 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.820029 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.820191 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.820345 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.820507 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.820507 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.821000 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.821164 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.821332 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.821569 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.821743 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.822281 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.822473 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.822696 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.822851 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.823016 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.823214 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.823378 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.823546 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.823702 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.823861 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.824015 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.824168 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.824329 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.824495 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.824657 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.824818 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.824975 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.825166 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.825336 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.825500 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.825663 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.825818 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.826073 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.826241 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.826409 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.826623 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.826805 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.826961 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.827170 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.827170 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.827479 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.827640 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 08:39:14.827802 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.827802 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.827802 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.827802 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.827802 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.827802 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.827802 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.827802 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.828976 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.828976 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.828976 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.828976 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.828976 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.828976 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.828976 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.828976 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.830240 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.830240 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.830240 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.830240 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.830240 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.830240 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.830240 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.830240 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.832241 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.832241 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.832241 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.832241 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.832241 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.832241 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.832241 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.832241 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.833456 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.833456 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.833456 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.833456 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.833456 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.833456 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.833456 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.834489 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.834489 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.834489 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.834967 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.835120 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.835595 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.836014 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.836348 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.836699 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.837050 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.837366 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.837747 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.838136 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.838436 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.838856 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.839999 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.839999 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.839999 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.840357 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.840574 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.840883 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.841206 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.841525 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.841873 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.842195 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.842530 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.842860 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.843182 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.843500 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.843815 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.844129 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.844442 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.845195 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.845597 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.845972 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.846335 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.846836 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.847240 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.847678 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.848553 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.848894 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.849244 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.849576 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.849897 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.850232 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_db.sqlalchemy.engines [None req-52ccf508-87e7-4e89-be5a-94c124532644 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:39:14.850339 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.850793 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.852769 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.852769 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.852769 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.853330 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.853696 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.854032 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.854462 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.854815 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.855158 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.855484 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.855815 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.856133 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.856514 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.856780 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.857108 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.857435 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.857763 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.858080 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.858417 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.858758 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.859075 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.859391 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.859706 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.860022 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.860338 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.860667 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.860997 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.861310 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.862464 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.862464 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.862855 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.863199 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.863594 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.863935 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.864255 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.864580 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.864896 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.865212 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.865535 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.865860 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.866190 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.866604 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.866873 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.867206 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.867564 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.867881 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.868231 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.868562 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:39:14.868808 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 08:39:14.892251 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_db.sqlalchemy.engines [None req-df74c0aa-a943-4d68-a62b-1f786492e607 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122257) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:39:14.930406 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.context [None req-52ccf508-87e7-4e89-be5a-94c124532644 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a857be9c-0064-448f-960e-2be952756e52(cell1) {{(pid=122256) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 08:39:14.934866 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52ccf508-87e7-4e89-be5a-94c124532644 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:14.936431 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52ccf508-87e7-4e89-be5a-94c124532644 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:14.937239 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52ccf508-87e7-4e89-be5a-94c124532644 None None] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:14.939190 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52ccf508-87e7-4e89-be5a-94c124532644 None None] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:14.950941 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_db.sqlalchemy.engines [None req-52ccf508-87e7-4e89-be5a-94c124532644 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:39:14.955485 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_db.sqlalchemy.engines [None req-52ccf508-87e7-4e89-be5a-94c124532644 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:39:14.975465 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.context [None req-df74c0aa-a943-4d68-a62b-1f786492e607 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a857be9c-0064-448f-960e-2be952756e52(cell1) {{(pid=122257) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 08:39:14.980134 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df74c0aa-a943-4d68-a62b-1f786492e607 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:14.981688 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df74c0aa-a943-4d68-a62b-1f786492e607 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:14.982516 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df74c0aa-a943-4d68-a62b-1f786492e607 None None] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:14.984432 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df74c0aa-a943-4d68-a62b-1f786492e607 None None] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:14.997655 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_db.sqlalchemy.engines [None req-df74c0aa-a943-4d68-a62b-1f786492e607 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122257) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:39:14.998991 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_db.sqlalchemy.engines [None req-df74c0aa-a943-4d68-a62b-1f786492e607 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122257) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:39:15.220097 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_db.sqlalchemy.engines [None req-52ccf508-87e7-4e89-be5a-94c124532644 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:39:15.268522 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_db.sqlalchemy.engines [None req-df74c0aa-a943-4d68-a62b-1f786492e607 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122257) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:39:15.556089 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: WARNING keystonemiddleware.auth_token [None req-52ccf508-87e7-4e89-be5a-94c124532644 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 08:39:15.562755 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: WARNING keystonemiddleware.auth_token [None req-52ccf508-87e7-4e89-be5a-94c124532644 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 08:39:15.599280 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: WARNING keystonemiddleware.auth_token [None req-df74c0aa-a943-4d68-a62b-1f786492e607 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 08:39:15.606202 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: WARNING keystonemiddleware.auth_token [None req-df74c0aa-a943-4d68-a62b-1f786492e607 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 08:39:15.912264 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: WARNING keystonemiddleware.auth_token [None req-52ccf508-87e7-4e89-be5a-94c124532644 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 08:39:15.918466 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: WARNING keystonemiddleware.auth_token [None req-52ccf508-87e7-4e89-be5a-94c124532644 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 08:39:15.922892 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555e782849c0 pid: 122256 (default app) Oct 28 08:39:15.953076 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: WARNING keystonemiddleware.auth_token [None req-df74c0aa-a943-4d68-a62b-1f786492e607 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 08:39:15.959004 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: WARNING keystonemiddleware.auth_token [None req-df74c0aa-a943-4d68-a62b-1f786492e607 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 08:39:15.964141 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555e782849c0 pid: 122257 (default app) Oct 28 08:39:51.018474 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-77f688af-977f-4ab5-b445-f84888c2524d tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] Action: 'create', calling method: .version_select at 0x7fed708d7f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1228354772"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:39:51.431003 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-461d4580-6e00-4b6d-802a-103db9f3a264 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1820043279", "imageRef": "339e99be-6a19-4324-aa16-6b690c25dede", "flavorRef": "452", "networks": [{"uuid": "baa97c96-d90c-4541-963c-2b8ac01daede"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:39:52.221744 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-461d4580-6e00-4b6d-802a-103db9f3a264 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] validate_networks() for [('baa97c96-d90c-4541-963c-2b8ac01daede', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:39:52.915093 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-77f688af-977f-4ab5-b445-f84888c2524d tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.219369 Oct 28 08:39:52.917073 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1/1] 10.222.0.76 () {60 vars in 1154 bytes} [Thu Oct 28 08:39:49 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 3224 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 28 08:39:53.271570 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cc6482d3-fde4-45e1-9d4c-68fa195edf88 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1072419775", "imageRef": "339e99be-6a19-4324-aa16-6b690c25dede", "flavorRef": "452", "networks": [{"uuid": "cd7b6ca0-55b9-4af1-a370-11fe1f05dca8"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:39:53.450552 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-cc6482d3-fde4-45e1-9d4c-68fa195edf88 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] validate_networks() for [('cd7b6ca0-55b9-4af1-a370-11fe1f05dca8', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:39:53.836657 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-461d4580-6e00-4b6d-802a-103db9f3a264 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:39:53.837753 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-461d4580-6e00-4b6d-802a-103db9f3a264 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:39:53.838382 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-461d4580-6e00-4b6d-802a-103db9f3a264 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:39:53.838970 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-461d4580-6e00-4b6d-802a-103db9f3a264 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:39:53.839541 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-461d4580-6e00-4b6d-802a-103db9f3a264 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:39:53.868591 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-461d4580-6e00-4b6d-802a-103db9f3a264 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:53.869213 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-461d4580-6e00-4b6d-802a-103db9f3a264 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:53.870194 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-461d4580-6e00-4b6d-802a-103db9f3a264 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:53.871288 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-461d4580-6e00-4b6d-802a-103db9f3a264 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:53.958672 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-461d4580-6e00-4b6d-802a-103db9f3a264 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Getting quotas for project 3831003e70cf4a62afb1393fbea6654e. Resources: {'instances', 'cores', 'ram'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:39:53.978991 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-461d4580-6e00-4b6d-802a-103db9f3a264 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Getting quotas for user e0a3f84e4d9b4c77aab465f1e4df493d and project 3831003e70cf4a62afb1393fbea6654e. Resources: {'instances', 'cores', 'ram'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:39:54.011780 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-461d4580-6e00-4b6d-802a-103db9f3a264 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:39:54.018847 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-461d4580-6e00-4b6d-802a-103db9f3a264 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='339e99be-6a19-4324-aa16-6b690c25dede',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:39:54.195426 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-461d4580-6e00-4b6d-802a-103db9f3a264 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.050235 Oct 28 08:39:54.199634 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1/2] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Oct 28 08:39:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 4058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:39:54.207755 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4f43087e-cbb8-4350-a374-3a69f8c73883 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] Calling method '.version_select at 0x7fed6fe5f8b0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:54.753415 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4f43087e-cbb8-4350-a374-3a69f8c73883 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/cd1b49ae-79fc-4cfb-99d8-13511625980a" status: 200 len: 346 microversion: 2.1 time: 0.549437 Oct 28 08:39:54.753945 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2/3] 10.222.0.76 () {58 vars in 1244 bytes} [Thu Oct 28 08:39:54 2021] GET /compute/v2.1/os-volumes/cd1b49ae-79fc-4cfb-99d8-13511625980a => generated 346 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:39:54.762418 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1262e77a-cf61-4f43-8ac9-3c666c4e359a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:54.764728 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1262e77a-cf61-4f43-8ac9-3c666c4e359a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:39:54.805150 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-cc6482d3-fde4-45e1-9d4c-68fa195edf88 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:39:54.806243 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-cc6482d3-fde4-45e1-9d4c-68fa195edf88 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:39:54.806921 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-cc6482d3-fde4-45e1-9d4c-68fa195edf88 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:39:54.807481 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-cc6482d3-fde4-45e1-9d4c-68fa195edf88 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:39:54.808076 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-cc6482d3-fde4-45e1-9d4c-68fa195edf88 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:39:54.836258 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc6482d3-fde4-45e1-9d4c-68fa195edf88 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:54.836634 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc6482d3-fde4-45e1-9d4c-68fa195edf88 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:54.837430 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc6482d3-fde4-45e1-9d4c-68fa195edf88 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:54.837858 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc6482d3-fde4-45e1-9d4c-68fa195edf88 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:54.909050 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-cc6482d3-fde4-45e1-9d4c-68fa195edf88 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Getting quotas for project 4e1ab98d27254ae9b953182c6f2d1fc1. Resources: {'instances', 'cores', 'ram'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:39:54.930997 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-cc6482d3-fde4-45e1-9d4c-68fa195edf88 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Getting quotas for user b4e000da3af24420a5d27011dc2fb95a and project 4e1ab98d27254ae9b953182c6f2d1fc1. Resources: {'instances', 'cores', 'ram'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:39:54.950709 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cc6482d3-fde4-45e1-9d4c-68fa195edf88 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:39:54.959736 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cc6482d3-fde4-45e1-9d4c-68fa195edf88 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='339e99be-6a19-4324-aa16-6b690c25dede',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:39:55.053276 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1262e77a-cf61-4f43-8ac9-3c666c4e359a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:39:55.085254 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1262e77a-cf61-4f43-8ac9-3c666c4e359a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1218 microversion: 2.1 time: 0.330040 Oct 28 08:39:55.087898 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3/4] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:39:54 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1218 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:39:55.092532 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ba947fa1-0781-4892-9b41-07490cc39800 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] Action: 'create', calling method: .version_select at 0x7fed6f5e7e50>, body: {"snapshot": {"volume_id": "cd1b49ae-79fc-4cfb-99d8-13511625980a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-789586193"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:39:55.146744 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cc6482d3-fde4-45e1-9d4c-68fa195edf88 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.227205 Oct 28 08:39:55.181572 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2/5] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Oct 28 08:39:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 2259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:39:55.200234 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b1ca33ef-c748-4712-8508-27124ed04c1a tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:55.200873 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b1ca33ef-c748-4712-8508-27124ed04c1a tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:39:55.708821 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ba947fa1-0781-4892-9b41-07490cc39800 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] 10.222.0.76 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.619756 Oct 28 08:39:55.709916 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4/6] 10.222.0.76 () {60 vars in 1161 bytes} [Thu Oct 28 08:39:55 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:39:55.720143 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ccc4bd7e-4ea9-47ae-928f-8417d5386d13 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] Calling method '.version_select at 0x7fed6f5fab80>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:55.771747 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-b1ca33ef-c748-4712-8508-27124ed04c1a tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:39:55.800546 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b1ca33ef-c748-4712-8508-27124ed04c1a tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1215 microversion: 2.1 time: 0.615239 Oct 28 08:39:55.803634 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3/7] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:39:55 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1215 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:39:55.826877 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ccc4bd7e-4ea9-47ae-928f-8417d5386d13 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/86637a48-b674-43e8-8c77-d855415afe1a" status: 200 len: 286 microversion: 2.1 time: 0.111023 Oct 28 08:39:55.827783 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 5/8] 10.222.0.76 () {58 vars in 1250 bytes} [Thu Oct 28 08:39:55 2021] GET /compute/v2.1/os-snapshots/86637a48-b674-43e8-8c77-d855415afe1a => generated 286 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:39:55.840526 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-51856940-5cee-4f7c-8116-eea25ff20cc8 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] Calling method '.version_select at 0x7fed7064fa60>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:56.034819 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-51856940-5cee-4f7c-8116-eea25ff20cc8 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.200025 Oct 28 08:39:56.035400 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4/9] 10.222.0.76 () {58 vars in 1139 bytes} [Thu Oct 28 08:39:55 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:39:56.047725 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6022859c-0f12-4b35-8fb4-a05e9605464a tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] Calling method '.version_select at 0x7fed710c8670>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:56.104985 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-16f7cece-8f6b-49c2-a316-7acfada21490 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:56.105951 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-16f7cece-8f6b-49c2-a316-7acfada21490 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:39:56.145443 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6022859c-0f12-4b35-8fb4-a05e9605464a tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/86637a48-b674-43e8-8c77-d855415afe1a" status: 200 len: 286 microversion: 2.1 time: 0.103651 Oct 28 08:39:56.146382 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 6/10] 10.222.0.76 () {58 vars in 1250 bytes} [Thu Oct 28 08:39:56 2021] GET /compute/v2.1/os-snapshots/86637a48-b674-43e8-8c77-d855415afe1a => generated 286 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:39:56.393919 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-16f7cece-8f6b-49c2-a316-7acfada21490 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:39:56.402829 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-16f7cece-8f6b-49c2-a316-7acfada21490 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1218 microversion: 2.1 time: 0.302135 Oct 28 08:39:56.404480 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 5/11] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:39:56 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1218 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:39:56.823789 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bdf8ad61-7f21-4b93-80a8-d3349f5a801d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:56.826130 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bdf8ad61-7f21-4b93-80a8-d3349f5a801d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:39:56.994930 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-bdf8ad61-7f21-4b93-80a8-d3349f5a801d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:39:57.009731 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bdf8ad61-7f21-4b93-80a8-d3349f5a801d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1215 microversion: 2.1 time: 0.192767 Oct 28 08:39:57.014485 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 7/12] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:39:56 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1215 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:39:57.158020 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4656115a-28c4-4dad-823e-801a96c2adf8 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] Calling method '.version_select at 0x7fed6f609430>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:57.209483 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4656115a-28c4-4dad-823e-801a96c2adf8 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/86637a48-b674-43e8-8c77-d855415afe1a" status: 200 len: 286 microversion: 2.1 time: 0.055851 Oct 28 08:39:57.213428 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 6/13] 10.222.0.76 () {58 vars in 1250 bytes} [Thu Oct 28 08:39:57 2021] GET /compute/v2.1/os-snapshots/86637a48-b674-43e8-8c77-d855415afe1a => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:39:57.422658 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-88fcc84b-a6e2-41b5-98a3-f5918d7d9b44 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:57.423840 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-88fcc84b-a6e2-41b5-98a3-f5918d7d9b44 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:39:57.431280 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88fcc84b-a6e2-41b5-98a3-f5918d7d9b44 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:57.431726 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88fcc84b-a6e2-41b5-98a3-f5918d7d9b44 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:57.432503 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88fcc84b-a6e2-41b5-98a3-f5918d7d9b44 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:57.432934 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88fcc84b-a6e2-41b5-98a3-f5918d7d9b44 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:57.764162 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-88fcc84b-a6e2-41b5-98a3-f5918d7d9b44 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:39:57.787674 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-88fcc84b-a6e2-41b5-98a3-f5918d7d9b44 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1222 microversion: 2.1 time: 0.369897 Oct 28 08:39:57.788879 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 8/14] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:39:57 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1222 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:39:58.032850 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f63b3905-3016-472b-ad20-5cd6d3961a0f tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:58.033695 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f63b3905-3016-472b-ad20-5cd6d3961a0f tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:39:58.050811 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f63b3905-3016-472b-ad20-5cd6d3961a0f tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:58.051541 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f63b3905-3016-472b-ad20-5cd6d3961a0f tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:58.052503 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f63b3905-3016-472b-ad20-5cd6d3961a0f tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:58.053095 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f63b3905-3016-472b-ad20-5cd6d3961a0f tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:58.220196 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6b8a81da-a9fa-4092-89b3-84aa8828e274 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] Calling method '.version_select at 0x7fed6f589a60>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:58.299654 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6b8a81da-a9fa-4092-89b3-84aa8828e274 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/86637a48-b674-43e8-8c77-d855415afe1a" status: 200 len: 286 microversion: 2.1 time: 0.081113 Oct 28 08:39:58.300846 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 9/15] 10.222.0.76 () {58 vars in 1250 bytes} [Thu Oct 28 08:39:58 2021] GET /compute/v2.1/os-snapshots/86637a48-b674-43e8-8c77-d855415afe1a => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:39:58.679119 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-f63b3905-3016-472b-ad20-5cd6d3961a0f tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:39:58.701540 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f63b3905-3016-472b-ad20-5cd6d3961a0f tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1219 microversion: 2.1 time: 0.673412 Oct 28 08:39:58.710901 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 7/16] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:39:58 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1219 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:39:58.804548 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0847755f-6058-4722-86f6-08dabb89d0e3 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:58.805147 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0847755f-6058-4722-86f6-08dabb89d0e3 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:39:58.825911 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0847755f-6058-4722-86f6-08dabb89d0e3 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:58.826360 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0847755f-6058-4722-86f6-08dabb89d0e3 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:58.827486 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0847755f-6058-4722-86f6-08dabb89d0e3 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:58.827615 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0847755f-6058-4722-86f6-08dabb89d0e3 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:59.159148 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-0847755f-6058-4722-86f6-08dabb89d0e3 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:39:59.171683 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0847755f-6058-4722-86f6-08dabb89d0e3 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1222 microversion: 2.1 time: 0.366956 Oct 28 08:39:59.196081 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 10/17] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:39:58 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1222 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:39:59.311550 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-46a7badb-7112-4879-b3e1-8eb330b9c4df tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] Calling method '.version_select at 0x7fed6f58b9d0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:59.369249 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-46a7badb-7112-4879-b3e1-8eb330b9c4df tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/86637a48-b674-43e8-8c77-d855415afe1a" status: 200 len: 286 microversion: 2.1 time: 0.061268 Oct 28 08:39:59.370304 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 8/18] 10.222.0.76 () {58 vars in 1250 bytes} [Thu Oct 28 08:39:59 2021] GET /compute/v2.1/os-snapshots/86637a48-b674-43e8-8c77-d855415afe1a => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:39:59.721227 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-70b5bffc-7279-4a8e-b821-4494c9d7d3c6 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:39:59.722175 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-70b5bffc-7279-4a8e-b821-4494c9d7d3c6 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:39:59.746970 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70b5bffc-7279-4a8e-b821-4494c9d7d3c6 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:59.747582 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70b5bffc-7279-4a8e-b821-4494c9d7d3c6 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:39:59.753734 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70b5bffc-7279-4a8e-b821-4494c9d7d3c6 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:39:59.757625 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70b5bffc-7279-4a8e-b821-4494c9d7d3c6 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:00.177317 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-70b5bffc-7279-4a8e-b821-4494c9d7d3c6 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:00.188164 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-70b5bffc-7279-4a8e-b821-4494c9d7d3c6 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1219 microversion: 2.1 time: 0.470829 Oct 28 08:40:00.190848 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-97261e2f-d6b1-4761-9e03-64e75532e05e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:00.191472 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-97261e2f-d6b1-4761-9e03-64e75532e05e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:00.206865 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 11/19] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:39:59 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1219 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:00.211069 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97261e2f-d6b1-4761-9e03-64e75532e05e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:00.211908 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97261e2f-d6b1-4761-9e03-64e75532e05e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:00.213962 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97261e2f-d6b1-4761-9e03-64e75532e05e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:00.215670 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97261e2f-d6b1-4761-9e03-64e75532e05e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:00.381038 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8367dce9-1ae2-4d9c-b22b-05e5b19faee2 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] Calling method '.version_select at 0x7fed6f589160>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:00.431259 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8367dce9-1ae2-4d9c-b22b-05e5b19faee2 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/86637a48-b674-43e8-8c77-d855415afe1a" status: 200 len: 286 microversion: 2.1 time: 0.053691 Oct 28 08:40:00.432498 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 12/20] 10.222.0.76 () {58 vars in 1250 bytes} [Thu Oct 28 08:40:00 2021] GET /compute/v2.1/os-snapshots/86637a48-b674-43e8-8c77-d855415afe1a => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:40:00.569206 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-97261e2f-d6b1-4761-9e03-64e75532e05e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:00.595628 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-97261e2f-d6b1-4761-9e03-64e75532e05e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1222 microversion: 2.1 time: 0.408250 Oct 28 08:40:00.599426 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 9/21] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:00 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1222 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:01.074137 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e2bed963-4cb3-458d-889d-42a821f9d607 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1166024288", "imageRef": "339e99be-6a19-4324-aa16-6b690c25dede", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a6961ac-87c8-49d5-9235-d489fd741dcf"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:01.213483 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dcb62248-f8f1-4935-aaad-3a6245455acf tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:01.215707 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dcb62248-f8f1-4935-aaad-3a6245455acf tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:01.224666 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-e2bed963-4cb3-458d-889d-42a821f9d607 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] validate_networks() for [('6a6961ac-87c8-49d5-9235-d489fd741dcf', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:40:01.228806 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dcb62248-f8f1-4935-aaad-3a6245455acf tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:01.232212 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dcb62248-f8f1-4935-aaad-3a6245455acf tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:01.237412 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dcb62248-f8f1-4935-aaad-3a6245455acf tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:01.240348 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dcb62248-f8f1-4935-aaad-3a6245455acf tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:01.694521 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-dcb62248-f8f1-4935-aaad-3a6245455acf tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:01.710256 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dcb62248-f8f1-4935-aaad-3a6245455acf tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1267 microversion: 2.1 time: 0.502070 Oct 28 08:40:01.723984 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 10/22] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:01 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1267 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:01.736751 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-121ecbd1-9892-4c9d-a791-3acd7849fd9d tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] Calling method '.version_select at 0x7fed6f51b4c0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:01.809643 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-121ecbd1-9892-4c9d-a791-3acd7849fd9d tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/86637a48-b674-43e8-8c77-d855415afe1a" status: 200 len: 287 microversion: 2.1 time: 0.084036 Oct 28 08:40:01.818790 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 11/23] 10.222.0.76 () {58 vars in 1250 bytes} [Thu Oct 28 08:40:01 2021] GET /compute/v2.1/os-snapshots/86637a48-b674-43e8-8c77-d855415afe1a => generated 287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:01.836519 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4d287e7a-686f-451a-902e-758b0b57da37 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:01.838412 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4d287e7a-686f-451a-902e-758b0b57da37 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:01.864936 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d287e7a-686f-451a-902e-758b0b57da37 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:01.866197 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d287e7a-686f-451a-902e-758b0b57da37 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:01.868156 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d287e7a-686f-451a-902e-758b0b57da37 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:01.870780 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d287e7a-686f-451a-902e-758b0b57da37 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:02.091981 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-4d287e7a-686f-451a-902e-758b0b57da37 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:02.101601 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4d287e7a-686f-451a-902e-758b0b57da37 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1214 microversion: 2.1 time: 0.273098 Oct 28 08:40:02.102193 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 12/24] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:01 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1214 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:02.118179 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-db9077c2-e048-4674-b22c-a3ee968f7934 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] Calling method '.version_select at 0x7fed6f58b700>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:02.322817 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-db9077c2-e048-4674-b22c-a3ee968f7934 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] 10.222.0.76 "DELETE /compute/v2.1/os-snapshots/86637a48-b674-43e8-8c77-d855415afe1a" status: 202 len: 0 microversion: 2.1 time: 0.215264 Oct 28 08:40:02.326853 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 13/25] 10.222.0.76 () {58 vars in 1253 bytes} [Thu Oct 28 08:40:02 2021] DELETE /compute/v2.1/os-snapshots/86637a48-b674-43e8-8c77-d855415afe1a => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:40:02.332499 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e4058592-1c9d-4b79-8984-344e5c112200 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] Calling method '.version_select at 0x7fed6f4d9670>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:02.393877 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e4058592-1c9d-4b79-8984-344e5c112200 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/86637a48-b674-43e8-8c77-d855415afe1a" status: 200 len: 286 microversion: 2.1 time: 0.065840 Oct 28 08:40:02.399656 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 14/26] 10.222.0.76 () {58 vars in 1250 bytes} [Thu Oct 28 08:40:02 2021] GET /compute/v2.1/os-snapshots/86637a48-b674-43e8-8c77-d855415afe1a => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:02.736758 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c8952a7f-66e5-4da1-9941-314148d58582 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:02.738597 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c8952a7f-66e5-4da1-9941-314148d58582 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:02.768713 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8952a7f-66e5-4da1-9941-314148d58582 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:02.769273 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8952a7f-66e5-4da1-9941-314148d58582 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:02.770112 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8952a7f-66e5-4da1-9941-314148d58582 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:02.770577 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8952a7f-66e5-4da1-9941-314148d58582 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:02.929073 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c8952a7f-66e5-4da1-9941-314148d58582 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:02.958044 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c8952a7f-66e5-4da1-9941-314148d58582 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1267 microversion: 2.1 time: 0.221469 Oct 28 08:40:02.958937 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 15/27] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:02 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:03.044162 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-e2bed963-4cb3-458d-889d-42a821f9d607 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:40:03.045147 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-e2bed963-4cb3-458d-889d-42a821f9d607 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:40:03.047045 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-e2bed963-4cb3-458d-889d-42a821f9d607 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:40:03.049022 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-e2bed963-4cb3-458d-889d-42a821f9d607 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:40:03.049729 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-e2bed963-4cb3-458d-889d-42a821f9d607 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:40:03.066919 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2bed963-4cb3-458d-889d-42a821f9d607 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:03.068224 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2bed963-4cb3-458d-889d-42a821f9d607 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:03.070095 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2bed963-4cb3-458d-889d-42a821f9d607 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:03.070914 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2bed963-4cb3-458d-889d-42a821f9d607 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:03.123704 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-e2bed963-4cb3-458d-889d-42a821f9d607 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Getting quotas for project 241b556f8519472bb4fbe40400334a65. Resources: {'instances', 'cores', 'ram'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:40:03.140824 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-e2bed963-4cb3-458d-889d-42a821f9d607 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Getting quotas for user aaeb0fe842e54e3b9f0750069d83231c and project 241b556f8519472bb4fbe40400334a65. Resources: {'instances', 'cores', 'ram'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:40:03.184728 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e2bed963-4cb3-458d-889d-42a821f9d607 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:40:03.191748 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e2bed963-4cb3-458d-889d-42a821f9d607 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='339e99be-6a19-4324-aa16-6b690c25dede',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:40:03.331209 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e2bed963-4cb3-458d-889d-42a821f9d607 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.538236 Oct 28 08:40:03.331859 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 13/28] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Oct 28 08:40:00 2021] POST /compute/v2.1/servers => generated 383 bytes in 2540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 08:40:03.342946 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a0a62560-b625-4063-b9bc-533e9e375fe1 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:03.343690 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a0a62560-b625-4063-b9bc-533e9e375fe1 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:03.348081 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fbc17ce6-2488-4142-b12d-61bc59e5a9bf tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'create', calling method: .version_select at 0x7fed7064f8b0>, body: {"keypair": {"name": "tempest-keypair-1089437154"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:03.351691 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a0a62560-b625-4063-b9bc-533e9e375fe1 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:03.352329 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a0a62560-b625-4063-b9bc-533e9e375fe1 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:03.353279 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a0a62560-b625-4063-b9bc-533e9e375fe1 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:03.353902 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a0a62560-b625-4063-b9bc-533e9e375fe1 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:03.425514 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-fbc17ce6-2488-4142-b12d-61bc59e5a9bf tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Getting quotas for project d12dfed3afe746b58b897b104b2a78ae. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:40:03.433337 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-fbc17ce6-2488-4142-b12d-61bc59e5a9bf tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Getting quotas for user 483af16bae1f4521ad3e3138bbc86123 and project d12dfed3afe746b58b897b104b2a78ae. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:40:03.600848 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-a0a62560-b625-4063-b9bc-533e9e375fe1 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:03.634184 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a0a62560-b625-4063-b9bc-533e9e375fe1 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1214 microversion: 2.1 time: 0.299729 Oct 28 08:40:03.637153 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 14/29] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:03 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1214 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:03.641648 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-acf42699-3df6-47cc-9915-a5e1fc639aa8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:03.642308 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-acf42699-3df6-47cc-9915-a5e1fc639aa8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:03.737161 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-acf42699-3df6-47cc-9915-a5e1fc639aa8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:03.744818 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-fbc17ce6-2488-4142-b12d-61bc59e5a9bf tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Getting quotas for project d12dfed3afe746b58b897b104b2a78ae. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:40:03.753058 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-acf42699-3df6-47cc-9915-a5e1fc639aa8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1222 microversion: 2.1 time: 0.114753 Oct 28 08:40:03.753320 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-fbc17ce6-2488-4142-b12d-61bc59e5a9bf tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Getting quotas for user 483af16bae1f4521ad3e3138bbc86123 and project d12dfed3afe746b58b897b104b2a78ae. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:40:03.760493 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 15/30] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:03 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1222 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:03.774292 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9c543a8a-b85a-4c10-937e-d426c6469727 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] Calling method '.version_select at 0x7fed6f52cc10>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:03.803674 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fbc17ce6-2488-4142-b12d-61bc59e5a9bf tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.843239 Oct 28 08:40:03.806416 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 16/31] 10.222.0.76 () {60 vars in 1157 bytes} [Thu Oct 28 08:40:02 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:03.842628 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9c543a8a-b85a-4c10-937e-d426c6469727 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/86637a48-b674-43e8-8c77-d855415afe1a" status: 200 len: 286 microversion: 2.1 time: 0.078903 Oct 28 08:40:03.843244 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 16/32] 10.222.0.76 () {58 vars in 1250 bytes} [Thu Oct 28 08:40:03 2021] GET /compute/v2.1/os-snapshots/86637a48-b674-43e8-8c77-d855415afe1a => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:03.976701 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8eb1dc46-2f61-4388-bb00-44132f5f27d6 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:03.977388 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8eb1dc46-2f61-4388-bb00-44132f5f27d6 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:03.996151 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8eb1dc46-2f61-4388-bb00-44132f5f27d6 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:03.997067 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8eb1dc46-2f61-4388-bb00-44132f5f27d6 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:04.002974 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8eb1dc46-2f61-4388-bb00-44132f5f27d6 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:04.003740 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8eb1dc46-2f61-4388-bb00-44132f5f27d6 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:04.046323 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-02dca2f2-1ae9-4163-adba-b682f96e919c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1167059450", "imageRef": "339e99be-6a19-4324-aa16-6b690c25dede", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a6961ac-87c8-49d5-9235-d489fd741dcf"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:04.140936 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-02dca2f2-1ae9-4163-adba-b682f96e919c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] validate_networks() for [('6a6961ac-87c8-49d5-9235-d489fd741dcf', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:40:04.223519 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-8eb1dc46-2f61-4388-bb00-44132f5f27d6 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:04.248541 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8eb1dc46-2f61-4388-bb00-44132f5f27d6 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1275 microversion: 2.1 time: 0.271143 Oct 28 08:40:04.250407 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 17/33] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:03 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1275 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:04.653952 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-34691ce9-b140-4312-bca3-47499b7cee13 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:04.654609 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-34691ce9-b140-4312-bca3-47499b7cee13 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:04.669001 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34691ce9-b140-4312-bca3-47499b7cee13 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:04.669794 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34691ce9-b140-4312-bca3-47499b7cee13 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:04.676537 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34691ce9-b140-4312-bca3-47499b7cee13 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:04.677350 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34691ce9-b140-4312-bca3-47499b7cee13 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:05.044390 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-34691ce9-b140-4312-bca3-47499b7cee13 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:05.056902 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-34691ce9-b140-4312-bca3-47499b7cee13 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1270 microversion: 2.1 time: 0.407471 Oct 28 08:40:05.057627 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 18/34] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:04 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1270 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:05.086033 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2205669e-a41b-4a18-87dd-9ed0b4aa4b27 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] Calling method '.version_select at 0x7fed6f601c10>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:05.135104 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2205669e-a41b-4a18-87dd-9ed0b4aa4b27 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/86637a48-b674-43e8-8c77-d855415afe1a" status: 200 len: 286 microversion: 2.1 time: 0.057271 Oct 28 08:40:05.147355 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 19/35] 10.222.0.76 () {58 vars in 1250 bytes} [Thu Oct 28 08:40:05 2021] GET /compute/v2.1/os-snapshots/86637a48-b674-43e8-8c77-d855415afe1a => generated 286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:05.359175 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b08af3af-ff09-42f4-a34b-4a32adad5b61 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'create', calling method: .version_select at 0x7fed710c9670>, body: {"keypair": {"name": "tempest-keypair-410872415"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:05.409869 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-b08af3af-ff09-42f4-a34b-4a32adad5b61 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Getting quotas for project caed8624c42e4e4aab79cb3ca12ef824. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:40:05.418842 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-b08af3af-ff09-42f4-a34b-4a32adad5b61 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Getting quotas for user a8a8c3c685aa49499037c493b1b99eed and project caed8624c42e4e4aab79cb3ca12ef824. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:40:05.608684 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-02dca2f2-1ae9-4163-adba-b682f96e919c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:40:05.609291 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-02dca2f2-1ae9-4163-adba-b682f96e919c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:40:05.610025 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-02dca2f2-1ae9-4163-adba-b682f96e919c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:40:05.610651 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-02dca2f2-1ae9-4163-adba-b682f96e919c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:40:05.611261 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-02dca2f2-1ae9-4163-adba-b682f96e919c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:40:05.626145 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-02dca2f2-1ae9-4163-adba-b682f96e919c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:05.632188 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-02dca2f2-1ae9-4163-adba-b682f96e919c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:05.633540 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-02dca2f2-1ae9-4163-adba-b682f96e919c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:05.634606 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-02dca2f2-1ae9-4163-adba-b682f96e919c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:05.700355 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-02dca2f2-1ae9-4163-adba-b682f96e919c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Getting quotas for project 241b556f8519472bb4fbe40400334a65. Resources: {'instances', 'cores', 'ram'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:40:05.713171 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-02dca2f2-1ae9-4163-adba-b682f96e919c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Getting quotas for user aaeb0fe842e54e3b9f0750069d83231c and project 241b556f8519472bb4fbe40400334a65. Resources: {'instances', 'cores', 'ram'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:40:05.739118 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-02dca2f2-1ae9-4163-adba-b682f96e919c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:40:05.743257 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-02dca2f2-1ae9-4163-adba-b682f96e919c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='339e99be-6a19-4324-aa16-6b690c25dede',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:40:05.835175 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-02dca2f2-1ae9-4163-adba-b682f96e919c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.793003 Oct 28 08:40:05.858186 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 17/36] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Oct 28 08:40:04 2021] POST /compute/v2.1/servers => generated 383 bytes in 1817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 08:40:05.863824 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6e48eaef-32f3-47e4-aab5-f0b525577acc tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:05.878344 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6e48eaef-32f3-47e4-aab5-f0b525577acc tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:05.897035 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e48eaef-32f3-47e4-aab5-f0b525577acc tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:05.897775 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e48eaef-32f3-47e4-aab5-f0b525577acc tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:05.900627 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e48eaef-32f3-47e4-aab5-f0b525577acc tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:05.901739 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e48eaef-32f3-47e4-aab5-f0b525577acc tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:06.183357 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-b08af3af-ff09-42f4-a34b-4a32adad5b61 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Getting quotas for project caed8624c42e4e4aab79cb3ca12ef824. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:40:06.203148 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-b08af3af-ff09-42f4-a34b-4a32adad5b61 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Getting quotas for user a8a8c3c685aa49499037c493b1b99eed and project caed8624c42e4e4aab79cb3ca12ef824. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:40:06.295640 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b08af3af-ff09-42f4-a34b-4a32adad5b61 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.146902 Oct 28 08:40:06.303161 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-6e48eaef-32f3-47e4-aab5-f0b525577acc tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:06.317031 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6e48eaef-32f3-47e4-aab5-f0b525577acc tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1273 microversion: 2.1 time: 0.457436 Oct 28 08:40:06.317580 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 20/37] 10.222.0.76 () {62 vars in 1198 bytes} [Thu Oct 28 08:40:05 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1169 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 28 08:40:06.331776 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 18/38] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:05 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1273 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:06.331776 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4c72f829-7af6-4ae1-b6f6-1c51556cb70e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:06.331776 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4c72f829-7af6-4ae1-b6f6-1c51556cb70e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:06.334079 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-47cd646c-4696-4aab-b0c6-a07c5c6fd3bb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:06.337806 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-47cd646c-4696-4aab-b0c6-a07c5c6fd3bb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:06.363208 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c72f829-7af6-4ae1-b6f6-1c51556cb70e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:06.366971 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c72f829-7af6-4ae1-b6f6-1c51556cb70e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:06.367956 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c72f829-7af6-4ae1-b6f6-1c51556cb70e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:06.368473 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c72f829-7af6-4ae1-b6f6-1c51556cb70e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:06.550672 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-4c72f829-7af6-4ae1-b6f6-1c51556cb70e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:06.562561 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4c72f829-7af6-4ae1-b6f6-1c51556cb70e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1276 microversion: 2.1 time: 0.238224 Oct 28 08:40:06.567809 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 19/39] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:06 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1276 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:06.579260 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-41591146-6be5-4512-ac22-b0e33232feef tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] Calling method '.version_select at 0x7fed6f4da160>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:06.599628 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-47cd646c-4696-4aab-b0c6-a07c5c6fd3bb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:06.608222 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-47cd646c-4696-4aab-b0c6-a07c5c6fd3bb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1222 microversion: 2.1 time: 0.289429 Oct 28 08:40:06.609843 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 21/40] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:06 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1222 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:06.838838 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-41591146-6be5-4512-ac22-b0e33232feef tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] HTTP exception thrown: Snapshot 86637a48-b674-43e8-8c77-d855415afe1a could not be found. Oct 28 08:40:06.839702 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-41591146-6be5-4512-ac22-b0e33232feef tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] Returning 404 to user: Snapshot 86637a48-b674-43e8-8c77-d855415afe1a could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:40:06.840804 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-41591146-6be5-4512-ac22-b0e33232feef tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/86637a48-b674-43e8-8c77-d855415afe1a" status: 404 len: 111 microversion: 2.1 time: 0.271797 Oct 28 08:40:06.841874 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 20/41] 10.222.0.76 () {58 vars in 1250 bytes} [Thu Oct 28 08:40:06 2021] GET /compute/v2.1/os-snapshots/86637a48-b674-43e8-8c77-d855415afe1a => generated 111 bytes in 273 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:40:06.851762 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1ad06d1d-9228-40bd-9191-9af720b569cf tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] Calling method '.version_select at 0x7fed6ecafe50>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:07.063808 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1ad06d1d-9228-40bd-9191-9af720b569cf tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/cd1b49ae-79fc-4cfb-99d8-13511625980a" status: 202 len: 0 microversion: 2.1 time: 0.216309 Oct 28 08:40:07.064464 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 22/42] 10.222.0.76 () {58 vars in 1247 bytes} [Thu Oct 28 08:40:06 2021] DELETE /compute/v2.1/os-volumes/cd1b49ae-79fc-4cfb-99d8-13511625980a => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:40:07.075552 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7b2d18be-3273-4647-8187-d8f4e66bab77 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] Calling method '.version_select at 0x7fed759aa310>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:07.241007 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7b2d18be-3273-4647-8187-d8f4e66bab77 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/cd1b49ae-79fc-4cfb-99d8-13511625980a" status: 200 len: 345 microversion: 2.1 time: 0.172114 Oct 28 08:40:07.242196 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 21/43] 10.222.0.76 () {58 vars in 1244 bytes} [Thu Oct 28 08:40:07 2021] GET /compute/v2.1/os-volumes/cd1b49ae-79fc-4cfb-99d8-13511625980a => generated 345 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:07.343981 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-574888c0-ecb1-49fe-87e5-665665ffe914 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:07.346400 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-574888c0-ecb1-49fe-87e5-665665ffe914 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:07.362627 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-574888c0-ecb1-49fe-87e5-665665ffe914 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:07.363222 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-574888c0-ecb1-49fe-87e5-665665ffe914 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:07.366564 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-574888c0-ecb1-49fe-87e5-665665ffe914 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:07.367172 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-574888c0-ecb1-49fe-87e5-665665ffe914 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:07.581358 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-041b5090-46dc-4902-95b2-9fbe940fda37 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:07.582172 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-041b5090-46dc-4902-95b2-9fbe940fda37 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:07.591415 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-041b5090-46dc-4902-95b2-9fbe940fda37 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:07.591860 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-041b5090-46dc-4902-95b2-9fbe940fda37 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:07.596885 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-041b5090-46dc-4902-95b2-9fbe940fda37 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:07.599942 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-041b5090-46dc-4902-95b2-9fbe940fda37 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:07.829851 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-574888c0-ecb1-49fe-87e5-665665ffe914 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:07.837432 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-574888c0-ecb1-49fe-87e5-665665ffe914 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1273 microversion: 2.1 time: 0.502009 Oct 28 08:40:07.838022 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 23/44] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:07 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1273 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:07.854576 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c02538aa-8e26-425d-9069-9ca99a0748d5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:07.854576 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c02538aa-8e26-425d-9069-9ca99a0748d5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:07.889604 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c02538aa-8e26-425d-9069-9ca99a0748d5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:07.890166 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c02538aa-8e26-425d-9069-9ca99a0748d5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:07.891398 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c02538aa-8e26-425d-9069-9ca99a0748d5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:07.893514 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c02538aa-8e26-425d-9069-9ca99a0748d5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:08.013554 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-041b5090-46dc-4902-95b2-9fbe940fda37 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:08.037496 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-041b5090-46dc-4902-95b2-9fbe940fda37 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1276 microversion: 2.1 time: 0.458595 Oct 28 08:40:08.049887 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 22/45] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:07 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1276 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:08.130709 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c02538aa-8e26-425d-9069-9ca99a0748d5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:08.138359 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c02538aa-8e26-425d-9069-9ca99a0748d5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1226 microversion: 2.1 time: 0.299298 Oct 28 08:40:08.147494 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 24/46] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:07 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1226 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:08.257207 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f81b5bc1-181e-4e12-8341-ac9f006dada4 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] Calling method '.version_select at 0x7fed6f4e7160>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:08.316554 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-f81b5bc1-181e-4e12-8341-ac9f006dada4 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] HTTP exception thrown: Volume cd1b49ae-79fc-4cfb-99d8-13511625980a could not be found. Oct 28 08:40:08.317227 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f81b5bc1-181e-4e12-8341-ac9f006dada4 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] Returning 404 to user: Volume cd1b49ae-79fc-4cfb-99d8-13511625980a could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:40:08.318776 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f81b5bc1-181e-4e12-8341-ac9f006dada4 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/cd1b49ae-79fc-4cfb-99d8-13511625980a" status: 404 len: 109 microversion: 2.1 time: 0.068801 Oct 28 08:40:08.320008 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 23/47] 10.222.0.76 () {58 vars in 1244 bytes} [Thu Oct 28 08:40:08 2021] GET /compute/v2.1/os-volumes/cd1b49ae-79fc-4cfb-99d8-13511625980a => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:40:08.332798 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-093bb8c5-de8e-43fe-9ea1-a9f0deb133a1 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] Calling method '.version_select at 0x7fed6eca2af0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:08.388046 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-093bb8c5-de8e-43fe-9ea1-a9f0deb133a1 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] HTTP exception thrown: Volume cd1b49ae-79fc-4cfb-99d8-13511625980a could not be found. Oct 28 08:40:08.398878 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-093bb8c5-de8e-43fe-9ea1-a9f0deb133a1 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] Returning 404 to user: Volume cd1b49ae-79fc-4cfb-99d8-13511625980a could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:40:08.404366 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-093bb8c5-de8e-43fe-9ea1-a9f0deb133a1 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/cd1b49ae-79fc-4cfb-99d8-13511625980a" status: 404 len: 109 microversion: 2.1 time: 0.074829 Oct 28 08:40:08.408533 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 25/48] 10.222.0.76 () {58 vars in 1247 bytes} [Thu Oct 28 08:40:08 2021] DELETE /compute/v2.1/os-volumes/cd1b49ae-79fc-4cfb-99d8-13511625980a => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:40:08.416732 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b5598726-b009-4ef1-b6f0-030c5bade245 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] Calling method '.version_select at 0x7fed6f53d790>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:08.459372 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-b5598726-b009-4ef1-b6f0-030c5bade245 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] HTTP exception thrown: Volume cd1b49ae-79fc-4cfb-99d8-13511625980a could not be found. Oct 28 08:40:08.472348 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b5598726-b009-4ef1-b6f0-030c5bade245 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] Returning 404 to user: Volume cd1b49ae-79fc-4cfb-99d8-13511625980a could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:40:08.472348 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b5598726-b009-4ef1-b6f0-030c5bade245 tempest-VolumesSnapshotsTestJSON-1890994355 tempest-VolumesSnapshotsTestJSON-1890994355-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/cd1b49ae-79fc-4cfb-99d8-13511625980a" status: 404 len: 109 microversion: 2.1 time: 0.048474 Oct 28 08:40:08.472348 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 24/49] 10.222.0.76 () {58 vars in 1244 bytes} [Thu Oct 28 08:40:08 2021] GET /compute/v2.1/os-volumes/cd1b49ae-79fc-4cfb-99d8-13511625980a => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:40:08.861813 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3daabb6c-8f7b-4909-bab9-34150cdcb975 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:08.862910 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3daabb6c-8f7b-4909-bab9-34150cdcb975 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:08.877871 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3daabb6c-8f7b-4909-bab9-34150cdcb975 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:08.881042 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3daabb6c-8f7b-4909-bab9-34150cdcb975 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:08.882274 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3daabb6c-8f7b-4909-bab9-34150cdcb975 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:08.887075 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3daabb6c-8f7b-4909-bab9-34150cdcb975 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:09.066980 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3b53fd3b-ce3c-4909-9b1e-8c88412dcb00 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:09.067753 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3b53fd3b-ce3c-4909-9b1e-8c88412dcb00 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:09.087397 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3b53fd3b-ce3c-4909-9b1e-8c88412dcb00 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:09.095459 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3b53fd3b-ce3c-4909-9b1e-8c88412dcb00 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:09.096657 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3b53fd3b-ce3c-4909-9b1e-8c88412dcb00 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:09.097310 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3b53fd3b-ce3c-4909-9b1e-8c88412dcb00 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:10.881182 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3b53fd3b-ce3c-4909-9b1e-8c88412dcb00 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:10.905570 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3b53fd3b-ce3c-4909-9b1e-8c88412dcb00 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 1.842280 Oct 28 08:40:10.908769 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 25/50] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:09 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:10.932462 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e7793821-b979-4f63-ba64-07e02f448d24 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:10.936794 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e7793821-b979-4f63-ba64-07e02f448d24 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:10.976683 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7793821-b979-4f63-ba64-07e02f448d24 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:10.977143 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7793821-b979-4f63-ba64-07e02f448d24 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:10.981113 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7793821-b979-4f63-ba64-07e02f448d24 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:10.983930 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7793821-b979-4f63-ba64-07e02f448d24 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:11.607580 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-3daabb6c-8f7b-4909-bab9-34150cdcb975 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:11.620755 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3daabb6c-8f7b-4909-bab9-34150cdcb975 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 2.767682 Oct 28 08:40:11.632387 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 26/51] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:08 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 2781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:11.653991 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-e7793821-b979-4f63-ba64-07e02f448d24 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:11.662355 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e7793821-b979-4f63-ba64-07e02f448d24 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1282 microversion: 2.1 time: 0.749304 Oct 28 08:40:11.666348 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 26/52] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:10 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1282 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:11.931885 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b4a2c790-eff7-41b5-b0c0-58087e78b8ce tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:11.933443 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b4a2c790-eff7-41b5-b0c0-58087e78b8ce tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:11.940961 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4a2c790-eff7-41b5-b0c0-58087e78b8ce tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:11.945561 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4a2c790-eff7-41b5-b0c0-58087e78b8ce tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:11.946609 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4a2c790-eff7-41b5-b0c0-58087e78b8ce tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:11.949797 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4a2c790-eff7-41b5-b0c0-58087e78b8ce tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:12.637625 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-05e77ddf-87a2-4f62-a4d9-ad4d7e9b4445 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:12.640114 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-05e77ddf-87a2-4f62-a4d9-ad4d7e9b4445 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:12.651096 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05e77ddf-87a2-4f62-a4d9-ad4d7e9b4445 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:12.657807 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05e77ddf-87a2-4f62-a4d9-ad4d7e9b4445 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:12.674146 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05e77ddf-87a2-4f62-a4d9-ad4d7e9b4445 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:12.674807 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05e77ddf-87a2-4f62-a4d9-ad4d7e9b4445 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:13.103967 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-b4a2c790-eff7-41b5-b0c0-58087e78b8ce tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:13.113172 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b4a2c790-eff7-41b5-b0c0-58087e78b8ce tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 1.190458 Oct 28 08:40:13.123520 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 27/53] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:11 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:13.159666 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3daebb64-3091-44c1-8c8e-b16398c621f8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:13.163078 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3daebb64-3091-44c1-8c8e-b16398c621f8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:13.177702 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3daebb64-3091-44c1-8c8e-b16398c621f8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:13.179950 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3daebb64-3091-44c1-8c8e-b16398c621f8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:13.182280 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3daebb64-3091-44c1-8c8e-b16398c621f8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:13.183211 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3daebb64-3091-44c1-8c8e-b16398c621f8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:13.393444 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-05e77ddf-87a2-4f62-a4d9-ad4d7e9b4445 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:13.406108 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-05e77ddf-87a2-4f62-a4d9-ad4d7e9b4445 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.767292 Oct 28 08:40:13.418187 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 27/54] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:12 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:13.433744 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ec4012e7-04d2-4ee3-878f-b5cbea285eec tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2058601745", "imageRef": "339e99be-6a19-4324-aa16-6b690c25dede", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "35511921-4507-4196-b423-3f07547df75c"}], "security_groups": [{"name": "tempest-securitygroup--289556136"}], "key_name": "tempest-keypair-1089437154", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:13.436130 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-3daebb64-3091-44c1-8c8e-b16398c621f8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:13.460899 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3daebb64-3091-44c1-8c8e-b16398c621f8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1280 microversion: 2.1 time: 0.323878 Oct 28 08:40:13.467174 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 28/55] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:13 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1280 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:13.823149 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-ec4012e7-04d2-4ee3-878f-b5cbea285eec tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] validate_networks() for [('35511921-4507-4196-b423-3f07547df75c', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:40:14.145028 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ab5e10a7-ed8d-49fd-8dc2-36c660c48a2d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:14.145684 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ab5e10a7-ed8d-49fd-8dc2-36c660c48a2d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:14.166285 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab5e10a7-ed8d-49fd-8dc2-36c660c48a2d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:14.170997 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab5e10a7-ed8d-49fd-8dc2-36c660c48a2d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:14.176463 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab5e10a7-ed8d-49fd-8dc2-36c660c48a2d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:14.180575 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab5e10a7-ed8d-49fd-8dc2-36c660c48a2d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:15.786126 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-ab5e10a7-ed8d-49fd-8dc2-36c660c48a2d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:15.796491 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ab5e10a7-ed8d-49fd-8dc2-36c660c48a2d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 1.656264 Oct 28 08:40:15.808947 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 29/56] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:14 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:15.822895 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9957ae59-b41f-4595-b919-5b0bd891410e tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:15.823976 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9957ae59-b41f-4595-b919-5b0bd891410e tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:15.834202 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9957ae59-b41f-4595-b919-5b0bd891410e tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:15.835109 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9957ae59-b41f-4595-b919-5b0bd891410e tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:15.836108 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9957ae59-b41f-4595-b919-5b0bd891410e tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:15.836818 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9957ae59-b41f-4595-b919-5b0bd891410e tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:16.392188 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-9957ae59-b41f-4595-b919-5b0bd891410e tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:16.402950 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9957ae59-b41f-4595-b919-5b0bd891410e tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.592683 Oct 28 08:40:16.403859 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 30/57] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:15 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:16.412694 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f75df419-725a-4ef8-b754-d86f8e5c5b97 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:16.413581 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f75df419-725a-4ef8-b754-d86f8e5c5b97 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:16.430144 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f75df419-725a-4ef8-b754-d86f8e5c5b97 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:16.433069 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f75df419-725a-4ef8-b754-d86f8e5c5b97 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:16.434326 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f75df419-725a-4ef8-b754-d86f8e5c5b97 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:16.434943 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f75df419-725a-4ef8-b754-d86f8e5c5b97 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:16.473416 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-ec4012e7-04d2-4ee3-878f-b5cbea285eec tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:40:16.474424 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-ec4012e7-04d2-4ee3-878f-b5cbea285eec tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:40:16.475157 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-ec4012e7-04d2-4ee3-878f-b5cbea285eec tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:40:16.475957 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-ec4012e7-04d2-4ee3-878f-b5cbea285eec tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:40:16.476519 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-ec4012e7-04d2-4ee3-878f-b5cbea285eec tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:40:16.492907 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ec4012e7-04d2-4ee3-878f-b5cbea285eec tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:16.493609 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ec4012e7-04d2-4ee3-878f-b5cbea285eec tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:16.495420 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ec4012e7-04d2-4ee3-878f-b5cbea285eec tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:16.496033 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ec4012e7-04d2-4ee3-878f-b5cbea285eec tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:16.540503 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-ec4012e7-04d2-4ee3-878f-b5cbea285eec tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Getting quotas for project d12dfed3afe746b58b897b104b2a78ae. Resources: {'instances', 'cores', 'ram'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:40:16.551642 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-ec4012e7-04d2-4ee3-878f-b5cbea285eec tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Getting quotas for user 483af16bae1f4521ad3e3138bbc86123 and project d12dfed3afe746b58b897b104b2a78ae. Resources: {'instances', 'cores', 'ram'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:40:16.597310 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ec4012e7-04d2-4ee3-878f-b5cbea285eec tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:40:16.612475 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ec4012e7-04d2-4ee3-878f-b5cbea285eec tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='339e99be-6a19-4324-aa16-6b690c25dede',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:40:16.633923 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-f75df419-725a-4ef8-b754-d86f8e5c5b97 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:16.643388 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f75df419-725a-4ef8-b754-d86f8e5c5b97 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.238249 Oct 28 08:40:16.644426 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 31/58] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:16 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:16.771471 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ec4012e7-04d2-4ee3-878f-b5cbea285eec tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.350871 Oct 28 08:40:16.774006 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 28/59] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Oct 28 08:40:13 2021] POST /compute/v2.1/servers => generated 401 bytes in 3355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:40:16.794538 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-36f724a2-de66-4083-8662-878d53502dd3 tempest-VolumesGetTestJSON-1639249217 tempest-VolumesGetTestJSON-1639249217-project] Action: 'create', calling method: .version_select at 0x7fed6f5481f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-799742095", "metadata": {"Type": "work"}}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:16.966132 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-a7b622c0-f208-4de7-8e81-46bb47f6c55c req-6fb25435-6b34-4ef8-bb11-9002a1d2381f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ef6e834-e02d-41aa-8962-4caf135b9d54", "tag": "9ea8a9e5-c360-4361-8ee7-43bd5674b3d6"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:16.970026 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:40:16.970026 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:40:17.003216 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a7b622c0-f208-4de7-8e81-46bb47f6c55c req-6fb25435-6b34-4ef8-bb11-9002a1d2381f service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:17.004020 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a7b622c0-f208-4de7-8e81-46bb47f6c55c req-6fb25435-6b34-4ef8-bb11-9002a1d2381f service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:17.072168 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-a7b622c0-f208-4de7-8e81-46bb47f6c55c req-6fb25435-6b34-4ef8-bb11-9002a1d2381f service nova] Creating event network-changed:9ea8a9e5-c360-4361-8ee7-43bd5674b3d6 for instance 2ef6e834-e02d-41aa-8962-4caf135b9d54 on hv-cinder-81565 Oct 28 08:40:17.072702 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a7b622c0-f208-4de7-8e81-46bb47f6c55c req-6fb25435-6b34-4ef8-bb11-9002a1d2381f service nova] Acquired lock "compute-rpcapi-router" {{(pid=122257) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 28 08:40:17.073866 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d17cb50e-37a2-4674-af78-a7a2b69be75c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:17.085470 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d17cb50e-37a2-4674-af78-a7a2b69be75c None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:17.086389 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d17cb50e-37a2-4674-af78-a7a2b69be75c None None] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:17.087227 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d17cb50e-37a2-4674-af78-a7a2b69be75c None None] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:17.119870 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.compute.rpcapi [None req-d17cb50e-37a2-4674-af78-a7a2b69be75c None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 28 08:40:17.121959 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d17cb50e-37a2-4674-af78-a7a2b69be75c None None] Releasing lock "compute-rpcapi-router" {{(pid=122257) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 28 08:40:17.190874 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d17cb50e-37a2-4674-af78-a7a2b69be75c None None] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.414743 Oct 28 08:40:17.191491 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 29/60] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:40:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:17.394236 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-bdcb826e-f3b1-4bd8-9f20-761fa20604e9 req-9c0a1f07-0329-4112-95f0-e827f36c1ccd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3127fb3d-04bf-4ef2-b534-cd6fd65f614f", "tag": "64609431-9691-46a8-a89b-e479eb357768"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:17.395765 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:40:17.395765 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:40:17.408033 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bdcb826e-f3b1-4bd8-9f20-761fa20604e9 req-9c0a1f07-0329-4112-95f0-e827f36c1ccd service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:17.436425 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bdcb826e-f3b1-4bd8-9f20-761fa20604e9 req-9c0a1f07-0329-4112-95f0-e827f36c1ccd service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:17.439272 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-bdcb826e-f3b1-4bd8-9f20-761fa20604e9 req-9c0a1f07-0329-4112-95f0-e827f36c1ccd service nova] Creating event network-changed:64609431-9691-46a8-a89b-e479eb357768 for instance 3127fb3d-04bf-4ef2-b534-cd6fd65f614f on hv-cinder-81565 Oct 28 08:40:17.446959 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-bdcb826e-f3b1-4bd8-9f20-761fa20604e9 req-9c0a1f07-0329-4112-95f0-e827f36c1ccd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.253873 Oct 28 08:40:17.459158 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 30/61] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:40:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:17.490336 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c668b0e9-201c-4145-849b-8328a450249e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:17.495538 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c668b0e9-201c-4145-849b-8328a450249e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:17.683893 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-36f724a2-de66-4083-8662-878d53502dd3 tempest-VolumesGetTestJSON-1639249217 tempest-VolumesGetTestJSON-1639249217-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.036726 Oct 28 08:40:17.692352 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 32/62] 10.222.0.76 () {60 vars in 1155 bytes} [Thu Oct 28 08:40:16 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 1047 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 28 08:40:17.715977 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1bbf5d5a-e800-47ee-8acd-250aecb5ef1c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:17.720082 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1bbf5d5a-e800-47ee-8acd-250aecb5ef1c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:17.739765 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1bbf5d5a-e800-47ee-8acd-250aecb5ef1c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:17.742884 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1bbf5d5a-e800-47ee-8acd-250aecb5ef1c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:17.746952 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1bbf5d5a-e800-47ee-8acd-250aecb5ef1c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:17.749202 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1bbf5d5a-e800-47ee-8acd-250aecb5ef1c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:17.791099 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-c668b0e9-201c-4145-849b-8328a450249e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:17.819674 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c668b0e9-201c-4145-849b-8328a450249e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1238 microversion: 2.1 time: 0.354212 Oct 28 08:40:17.821206 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 31/63] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:17 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1238 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:17.834704 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b3f9486f-46ed-4a2c-96cf-f5bd8a5bc70e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-592063292", "imageRef": "339e99be-6a19-4324-aa16-6b690c25dede", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "523f4404-9c20-4bbb-88e2-e5dcf3255867"}], "security_groups": [{"name": "tempest-securitygroup--1192853804"}], "key_name": "tempest-keypair-410872415", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:18.461608 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-b3f9486f-46ed-4a2c-96cf-f5bd8a5bc70e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] validate_networks() for [('523f4404-9c20-4bbb-88e2-e5dcf3255867', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:40:18.810657 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-1bbf5d5a-e800-47ee-8acd-250aecb5ef1c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:18.829275 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1bbf5d5a-e800-47ee-8acd-250aecb5ef1c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 1.134169 Oct 28 08:40:18.831003 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 33/64] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:17 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:18.843459 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ae3789db-3db6-4602-9327-9bc84d135358 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:18.845433 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ae3789db-3db6-4602-9327-9bc84d135358 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:18.856497 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae3789db-3db6-4602-9327-9bc84d135358 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:18.857092 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae3789db-3db6-4602-9327-9bc84d135358 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:18.858348 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae3789db-3db6-4602-9327-9bc84d135358 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:18.858898 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae3789db-3db6-4602-9327-9bc84d135358 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:19.209126 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-ae3789db-3db6-4602-9327-9bc84d135358 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:19.224606 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ae3789db-3db6-4602-9327-9bc84d135358 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.389109 Oct 28 08:40:19.225448 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 34/65] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:18 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:19.239153 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-694016ea-36ef-4f42-bb30-1b21511d1e52 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:19.239752 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-694016ea-36ef-4f42-bb30-1b21511d1e52 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:19.245813 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-694016ea-36ef-4f42-bb30-1b21511d1e52 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:19.246266 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-694016ea-36ef-4f42-bb30-1b21511d1e52 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:19.247343 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-694016ea-36ef-4f42-bb30-1b21511d1e52 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:19.247989 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-694016ea-36ef-4f42-bb30-1b21511d1e52 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:20.168338 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b3f9486f-46ed-4a2c-96cf-f5bd8a5bc70e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:40:20.169300 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b3f9486f-46ed-4a2c-96cf-f5bd8a5bc70e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:40:20.169931 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b3f9486f-46ed-4a2c-96cf-f5bd8a5bc70e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:40:20.171079 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b3f9486f-46ed-4a2c-96cf-f5bd8a5bc70e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:40:20.171660 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b3f9486f-46ed-4a2c-96cf-f5bd8a5bc70e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:40:20.180672 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-694016ea-36ef-4f42-bb30-1b21511d1e52 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:20.183896 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3f9486f-46ed-4a2c-96cf-f5bd8a5bc70e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:20.184497 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3f9486f-46ed-4a2c-96cf-f5bd8a5bc70e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:20.185481 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3f9486f-46ed-4a2c-96cf-f5bd8a5bc70e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:20.190289 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-694016ea-36ef-4f42-bb30-1b21511d1e52 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.954783 Oct 28 08:40:20.191025 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 35/66] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:19 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:20.192779 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3f9486f-46ed-4a2c-96cf-f5bd8a5bc70e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:20.196874 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bb83ba19-d25d-464a-aa34-c7b2f14e60fd tempest-VolumesGetTestJSON-1639249217 tempest-VolumesGetTestJSON-1639249217-project] Calling method '.version_select at 0x7fed6eca2040>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:20.211747 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-b3f9486f-46ed-4a2c-96cf-f5bd8a5bc70e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Getting quotas for project caed8624c42e4e4aab79cb3ca12ef824. Resources: {'instances', 'cores', 'ram'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:40:20.217347 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-b3f9486f-46ed-4a2c-96cf-f5bd8a5bc70e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Getting quotas for user a8a8c3c685aa49499037c493b1b99eed and project caed8624c42e4e4aab79cb3ca12ef824. Resources: {'instances', 'cores', 'ram'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:40:20.230032 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b3f9486f-46ed-4a2c-96cf-f5bd8a5bc70e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:40:20.232465 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b3f9486f-46ed-4a2c-96cf-f5bd8a5bc70e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='339e99be-6a19-4324-aa16-6b690c25dede',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:40:20.277243 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bb83ba19-d25d-464a-aa34-c7b2f14e60fd tempest-VolumesGetTestJSON-1639249217 tempest-VolumesGetTestJSON-1639249217-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/00fb99ef-ddf5-408d-ad3e-90b2a388cc4f" status: 200 len: 353 microversion: 2.1 time: 0.085109 Oct 28 08:40:20.284398 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 36/67] 10.222.0.76 () {58 vars in 1244 bytes} [Thu Oct 28 08:40:20 2021] GET /compute/v2.1/os-volumes/00fb99ef-ddf5-408d-ad3e-90b2a388cc4f => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:20.290189 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6e8f50d8-f85d-4a87-ba20-4dfbd49d35ca tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:20.293754 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b3f9486f-46ed-4a2c-96cf-f5bd8a5bc70e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.470129 Oct 28 08:40:20.294859 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 32/68] 10.222.0.76 () {62 vars in 1187 bytes} [Thu Oct 28 08:40:17 2021] POST /compute/v2.1/servers => generated 402 bytes in 2472 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 08:40:20.300837 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6e8f50d8-f85d-4a87-ba20-4dfbd49d35ca tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:20.308192 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e8f50d8-f85d-4a87-ba20-4dfbd49d35ca tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:20.308770 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-da26cb4a-d8cc-4ea2-ba22-bce2e840a871 req-fdbc6525-e67c-4301-8986-5b3dc4d24942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a432ca47-c48c-4e08-8b76-0025d9ef360b", "tag": "62e8969b-1684-48c9-a697-1e36b8bae48e"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:20.308982 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e8f50d8-f85d-4a87-ba20-4dfbd49d35ca tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:20.309908 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e8f50d8-f85d-4a87-ba20-4dfbd49d35ca tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:20.311074 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e8f50d8-f85d-4a87-ba20-4dfbd49d35ca tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:20.314057 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:40:20.314057 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:40:20.322736 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-da26cb4a-d8cc-4ea2-ba22-bce2e840a871 req-fdbc6525-e67c-4301-8986-5b3dc4d24942 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:20.323185 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-da26cb4a-d8cc-4ea2-ba22-bce2e840a871 req-fdbc6525-e67c-4301-8986-5b3dc4d24942 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:20.335160 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-da26cb4a-d8cc-4ea2-ba22-bce2e840a871 req-fdbc6525-e67c-4301-8986-5b3dc4d24942 service nova] Creating event network-changed:62e8969b-1684-48c9-a697-1e36b8bae48e for instance a432ca47-c48c-4e08-8b76-0025d9ef360b on hv-cinder-81565 Oct 28 08:40:20.340310 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-da26cb4a-d8cc-4ea2-ba22-bce2e840a871 req-fdbc6525-e67c-4301-8986-5b3dc4d24942 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044156 Oct 28 08:40:20.342624 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 33/69] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:40:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:20.349785 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c5c72a47-ca8b-44ad-84cd-23bb9477b806 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:20.350790 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c5c72a47-ca8b-44ad-84cd-23bb9477b806 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:20.357717 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5c72a47-ca8b-44ad-84cd-23bb9477b806 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:20.358268 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5c72a47-ca8b-44ad-84cd-23bb9477b806 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:20.359137 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5c72a47-ca8b-44ad-84cd-23bb9477b806 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:20.360227 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5c72a47-ca8b-44ad-84cd-23bb9477b806 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:20.487219 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-6e8f50d8-f85d-4a87-ba20-4dfbd49d35ca tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:20.496339 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6e8f50d8-f85d-4a87-ba20-4dfbd49d35ca tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1242 microversion: 2.1 time: 0.210597 Oct 28 08:40:20.497110 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 37/70] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:20 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1242 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:20.502764 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fadb77ca-9302-4cbf-93d0-9f4ad232b7d1 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:20.503566 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fadb77ca-9302-4cbf-93d0-9f4ad232b7d1 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:20.520717 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fadb77ca-9302-4cbf-93d0-9f4ad232b7d1 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:20.521182 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fadb77ca-9302-4cbf-93d0-9f4ad232b7d1 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:20.521977 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fadb77ca-9302-4cbf-93d0-9f4ad232b7d1 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:20.522413 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fadb77ca-9302-4cbf-93d0-9f4ad232b7d1 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:20.583995 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-c5c72a47-ca8b-44ad-84cd-23bb9477b806 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:20.593201 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c5c72a47-ca8b-44ad-84cd-23bb9477b806 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.248853 Oct 28 08:40:20.594061 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 34/71] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:20 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:20.598964 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6741bb83-3dc5-4871-a8c2-b8090a6e9204 tempest-VolumesGetTestJSON-1639249217 tempest-VolumesGetTestJSON-1639249217-project] Calling method '.version_select at 0x7fed6f468e50>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:20.663345 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6741bb83-3dc5-4871-a8c2-b8090a6e9204 tempest-VolumesGetTestJSON-1639249217 tempest-VolumesGetTestJSON-1639249217-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/00fb99ef-ddf5-408d-ad3e-90b2a388cc4f" status: 200 len: 353 microversion: 2.1 time: 0.067774 Oct 28 08:40:20.664642 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 35/72] 10.222.0.76 () {58 vars in 1244 bytes} [Thu Oct 28 08:40:20 2021] GET /compute/v2.1/os-volumes/00fb99ef-ddf5-408d-ad3e-90b2a388cc4f => generated 353 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:20.674226 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5790a237-d022-48b1-92b6-2120be146f43 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:20.675229 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5790a237-d022-48b1-92b6-2120be146f43 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:20.689408 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-fadb77ca-9302-4cbf-93d0-9f4ad232b7d1 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:20.697694 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fadb77ca-9302-4cbf-93d0-9f4ad232b7d1 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.199302 Oct 28 08:40:20.708023 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 38/73] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:20 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:20.717892 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-c899283d-561f-4405-9df4-908a8e611483 req-74171338-7e7c-4f44-8e5c-0be54ff05510 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fecc28dc-ead2-481a-a3a5-7b5702510113", "tag": "e8d31af7-741e-4880-988e-5bfcf3a45f01"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:20.720484 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:40:20.720484 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:40:20.746565 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c899283d-561f-4405-9df4-908a8e611483 req-74171338-7e7c-4f44-8e5c-0be54ff05510 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:20.746888 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c899283d-561f-4405-9df4-908a8e611483 req-74171338-7e7c-4f44-8e5c-0be54ff05510 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:20.747156 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-5790a237-d022-48b1-92b6-2120be146f43 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:20.761450 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-5790a237-d022-48b1-92b6-2120be146f43 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:20.763282 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-5790a237-d022-48b1-92b6-2120be146f43 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:20.764675 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5790a237-d022-48b1-92b6-2120be146f43 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1280 microversion: 2.20 time: 0.098792 Oct 28 08:40:20.765629 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 36/74] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:20 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1280 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:40:20.771824 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bda68266-6fb0-4d22-9205-782444be7df9 tempest-VolumesGetTestJSON-1639249217 tempest-VolumesGetTestJSON-1639249217-project] Calling method '.version_select at 0x7fed6f4daca0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:20.782689 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-c899283d-561f-4405-9df4-908a8e611483 req-74171338-7e7c-4f44-8e5c-0be54ff05510 service nova] Creating event network-changed:e8d31af7-741e-4880-988e-5bfcf3a45f01 for instance fecc28dc-ead2-481a-a3a5-7b5702510113 on hv-cinder-81565 Oct 28 08:40:20.783411 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c899283d-561f-4405-9df4-908a8e611483 req-74171338-7e7c-4f44-8e5c-0be54ff05510 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 28 08:40:20.784584 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e33f0b5c-03b1-4d7a-9a9b-a13f2052c68a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:20.785039 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e33f0b5c-03b1-4d7a-9a9b-a13f2052c68a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:20.785830 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e33f0b5c-03b1-4d7a-9a9b-a13f2052c68a None None] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:20.786280 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e33f0b5c-03b1-4d7a-9a9b-a13f2052c68a None None] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:20.797778 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.compute.rpcapi [None req-e33f0b5c-03b1-4d7a-9a9b-a13f2052c68a None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 28 08:40:20.798858 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e33f0b5c-03b1-4d7a-9a9b-a13f2052c68a None None] Releasing lock "compute-rpcapi-router" {{(pid=122256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 28 08:40:20.826363 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e33f0b5c-03b1-4d7a-9a9b-a13f2052c68a None None] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116644 Oct 28 08:40:20.827017 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 39/75] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:40:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:20.857831 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bda68266-6fb0-4d22-9205-782444be7df9 tempest-VolumesGetTestJSON-1639249217 tempest-VolumesGetTestJSON-1639249217-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/00fb99ef-ddf5-408d-ad3e-90b2a388cc4f" status: 202 len: 0 microversion: 2.1 time: 0.090167 Oct 28 08:40:20.862430 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 37/76] 10.222.0.76 () {58 vars in 1247 bytes} [Thu Oct 28 08:40:20 2021] DELETE /compute/v2.1/os-volumes/00fb99ef-ddf5-408d-ad3e-90b2a388cc4f => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:40:20.868162 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-caecf809-9613-4254-a1d5-c857631717db tempest-VolumesGetTestJSON-1639249217 tempest-VolumesGetTestJSON-1639249217-project] Calling method '.version_select at 0x7fed6f5480d0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:20.920309 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-caecf809-9613-4254-a1d5-c857631717db tempest-VolumesGetTestJSON-1639249217 tempest-VolumesGetTestJSON-1639249217-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/00fb99ef-ddf5-408d-ad3e-90b2a388cc4f" status: 200 len: 352 microversion: 2.1 time: 0.056523 Oct 28 08:40:20.921125 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 40/77] 10.222.0.76 () {58 vars in 1244 bytes} [Thu Oct 28 08:40:20 2021] GET /compute/v2.1/os-volumes/00fb99ef-ddf5-408d-ad3e-90b2a388cc4f => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:21.208789 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-17943ab8-9edc-46fa-8cfd-056a77b55267 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:21.211069 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-17943ab8-9edc-46fa-8cfd-056a77b55267 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:21.217299 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17943ab8-9edc-46fa-8cfd-056a77b55267 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:21.217741 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17943ab8-9edc-46fa-8cfd-056a77b55267 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:21.218558 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17943ab8-9edc-46fa-8cfd-056a77b55267 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:21.219150 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17943ab8-9edc-46fa-8cfd-056a77b55267 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:21.344925 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-17943ab8-9edc-46fa-8cfd-056a77b55267 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:21.356672 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-17943ab8-9edc-46fa-8cfd-056a77b55267 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.152939 Oct 28 08:40:21.357234 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 38/78] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:21 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:21.515214 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-48a1e62e-f8f5-4d85-81fc-c6a1e97e565b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:21.516717 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-48a1e62e-f8f5-4d85-81fc-c6a1e97e565b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:21.523108 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48a1e62e-f8f5-4d85-81fc-c6a1e97e565b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:21.523544 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48a1e62e-f8f5-4d85-81fc-c6a1e97e565b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:21.524307 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48a1e62e-f8f5-4d85-81fc-c6a1e97e565b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:21.524734 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48a1e62e-f8f5-4d85-81fc-c6a1e97e565b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:21.587579 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-48a1e62e-f8f5-4d85-81fc-c6a1e97e565b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:21.597013 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-48a1e62e-f8f5-4d85-81fc-c6a1e97e565b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1242 microversion: 2.1 time: 0.085609 Oct 28 08:40:21.597754 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 41/79] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:21 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:21.612513 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3803c467-033a-4c0f-8cc5-6195f905569a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:21.613380 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3803c467-033a-4c0f-8cc5-6195f905569a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:21.619400 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3803c467-033a-4c0f-8cc5-6195f905569a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:21.619833 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3803c467-033a-4c0f-8cc5-6195f905569a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:21.620584 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3803c467-033a-4c0f-8cc5-6195f905569a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:21.621003 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3803c467-033a-4c0f-8cc5-6195f905569a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:21.716040 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-55e393c7-96f9-47e3-b1eb-cc6b9f9599a3 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:21.717063 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-55e393c7-96f9-47e3-b1eb-cc6b9f9599a3 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:21.725004 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55e393c7-96f9-47e3-b1eb-cc6b9f9599a3 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:21.725817 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55e393c7-96f9-47e3-b1eb-cc6b9f9599a3 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:21.726736 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55e393c7-96f9-47e3-b1eb-cc6b9f9599a3 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:21.727232 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55e393c7-96f9-47e3-b1eb-cc6b9f9599a3 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:21.750187 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3803c467-033a-4c0f-8cc5-6195f905569a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:21.757936 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3803c467-033a-4c0f-8cc5-6195f905569a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.149981 Oct 28 08:40:21.758531 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 39/80] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:21 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:21.787674 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-84679ba1-b68c-45f6-a2fe-7e13255b7274 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:21.788368 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-84679ba1-b68c-45f6-a2fe-7e13255b7274 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:21.795954 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84679ba1-b68c-45f6-a2fe-7e13255b7274 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:21.796474 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84679ba1-b68c-45f6-a2fe-7e13255b7274 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:21.797539 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84679ba1-b68c-45f6-a2fe-7e13255b7274 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:21.798178 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84679ba1-b68c-45f6-a2fe-7e13255b7274 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:21.878300 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-84679ba1-b68c-45f6-a2fe-7e13255b7274 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:21.884874 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-55e393c7-96f9-47e3-b1eb-cc6b9f9599a3 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:21.887225 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-84679ba1-b68c-45f6-a2fe-7e13255b7274 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:21.888732 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-84679ba1-b68c-45f6-a2fe-7e13255b7274 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:21.889858 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-84679ba1-b68c-45f6-a2fe-7e13255b7274 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1284 microversion: 2.20 time: 0.106194 Oct 28 08:40:21.891040 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 40/81] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:21 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:40:21.897026 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-55e393c7-96f9-47e3-b1eb-cc6b9f9599a3 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.186020 Oct 28 08:40:21.897594 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 42/82] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:21 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:21.933322 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ec3137e3-ee30-434c-8fb1-8456e1787d59 tempest-VolumesGetTestJSON-1639249217 tempest-VolumesGetTestJSON-1639249217-project] Calling method '.version_select at 0x7fed6f468430>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:21.960293 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-ec3137e3-ee30-434c-8fb1-8456e1787d59 tempest-VolumesGetTestJSON-1639249217 tempest-VolumesGetTestJSON-1639249217-project] HTTP exception thrown: Volume 00fb99ef-ddf5-408d-ad3e-90b2a388cc4f could not be found. Oct 28 08:40:21.961254 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ec3137e3-ee30-434c-8fb1-8456e1787d59 tempest-VolumesGetTestJSON-1639249217 tempest-VolumesGetTestJSON-1639249217-project] Returning 404 to user: Volume 00fb99ef-ddf5-408d-ad3e-90b2a388cc4f could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:40:21.962274 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ec3137e3-ee30-434c-8fb1-8456e1787d59 tempest-VolumesGetTestJSON-1639249217 tempest-VolumesGetTestJSON-1639249217-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/00fb99ef-ddf5-408d-ad3e-90b2a388cc4f" status: 404 len: 109 microversion: 2.1 time: 0.032843 Oct 28 08:40:21.962980 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 41/83] 10.222.0.76 () {58 vars in 1244 bytes} [Thu Oct 28 08:40:21 2021] GET /compute/v2.1/os-volumes/00fb99ef-ddf5-408d-ad3e-90b2a388cc4f => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:40:22.373659 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e20e90a5-a0f4-4834-b6d8-dd21a5f1160f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:22.375971 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e20e90a5-a0f4-4834-b6d8-dd21a5f1160f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:22.384236 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e20e90a5-a0f4-4834-b6d8-dd21a5f1160f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:22.385072 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e20e90a5-a0f4-4834-b6d8-dd21a5f1160f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:22.386243 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e20e90a5-a0f4-4834-b6d8-dd21a5f1160f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:22.386988 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e20e90a5-a0f4-4834-b6d8-dd21a5f1160f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:22.551951 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-e20e90a5-a0f4-4834-b6d8-dd21a5f1160f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:22.559322 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e20e90a5-a0f4-4834-b6d8-dd21a5f1160f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.189916 Oct 28 08:40:22.560784 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 43/84] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:22 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:22.620094 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-67ec7dc7-17de-4bac-a104-fb37b40ba118 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:22.620713 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-67ec7dc7-17de-4bac-a104-fb37b40ba118 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:22.645584 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67ec7dc7-17de-4bac-a104-fb37b40ba118 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:22.653849 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67ec7dc7-17de-4bac-a104-fb37b40ba118 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:22.655042 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67ec7dc7-17de-4bac-a104-fb37b40ba118 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:22.655586 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67ec7dc7-17de-4bac-a104-fb37b40ba118 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:22.775667 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0abe6855-5598-4885-a9a6-a2d47c41e466 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:22.776532 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0abe6855-5598-4885-a9a6-a2d47c41e466 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:22.783242 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0abe6855-5598-4885-a9a6-a2d47c41e466 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:22.783926 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0abe6855-5598-4885-a9a6-a2d47c41e466 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:22.784854 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0abe6855-5598-4885-a9a6-a2d47c41e466 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:22.785597 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0abe6855-5598-4885-a9a6-a2d47c41e466 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:22.833555 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-67ec7dc7-17de-4bac-a104-fb37b40ba118 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:22.844314 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-67ec7dc7-17de-4bac-a104-fb37b40ba118 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1242 microversion: 2.1 time: 0.234396 Oct 28 08:40:22.845184 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 42/85] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:22 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1242 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:22.915847 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-876368e3-038d-4370-8f51-7f7c05cbd11c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:22.918526 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-876368e3-038d-4370-8f51-7f7c05cbd11c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:22.942140 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-876368e3-038d-4370-8f51-7f7c05cbd11c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:22.946605 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-876368e3-038d-4370-8f51-7f7c05cbd11c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:22.949773 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-876368e3-038d-4370-8f51-7f7c05cbd11c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:22.953018 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-876368e3-038d-4370-8f51-7f7c05cbd11c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:23.142417 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-876368e3-038d-4370-8f51-7f7c05cbd11c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:23.217482 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-876368e3-038d-4370-8f51-7f7c05cbd11c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:23.233882 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-876368e3-038d-4370-8f51-7f7c05cbd11c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:23.240525 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-876368e3-038d-4370-8f51-7f7c05cbd11c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1332 microversion: 2.20 time: 0.332527 Oct 28 08:40:23.244811 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 43/86] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:22 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1332 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:40:23.256824 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-0abe6855-5598-4885-a9a6-a2d47c41e466 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:23.259353 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d396c847-6b8f-4f6c-8f22-11b867ce36c3 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:23.261622 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d396c847-6b8f-4f6c-8f22-11b867ce36c3 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:23.264447 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0abe6855-5598-4885-a9a6-a2d47c41e466 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.492607 Oct 28 08:40:23.273662 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 44/87] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:22 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:23.277927 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d396c847-6b8f-4f6c-8f22-11b867ce36c3 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:23.281070 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d396c847-6b8f-4f6c-8f22-11b867ce36c3 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:23.284020 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d396c847-6b8f-4f6c-8f22-11b867ce36c3 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:23.284958 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d396c847-6b8f-4f6c-8f22-11b867ce36c3 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:23.577904 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7a796135-07af-4ac2-8015-c079b6725e02 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:23.579266 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7a796135-07af-4ac2-8015-c079b6725e02 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:23.594195 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a796135-07af-4ac2-8015-c079b6725e02 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:23.594565 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a796135-07af-4ac2-8015-c079b6725e02 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:23.595808 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a796135-07af-4ac2-8015-c079b6725e02 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:23.596698 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a796135-07af-4ac2-8015-c079b6725e02 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:23.923353 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-d396c847-6b8f-4f6c-8f22-11b867ce36c3 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:23.934531 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d396c847-6b8f-4f6c-8f22-11b867ce36c3 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.687880 Oct 28 08:40:23.935447 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 44/88] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:23 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:23.952000 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f8e73a2b-f3b2-48b5-b287-30f932668f2c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:23.952603 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f8e73a2b-f3b2-48b5-b287-30f932668f2c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:23.961450 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8e73a2b-f3b2-48b5-b287-30f932668f2c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:23.961891 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8e73a2b-f3b2-48b5-b287-30f932668f2c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:23.962686 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8e73a2b-f3b2-48b5-b287-30f932668f2c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:23.965981 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8e73a2b-f3b2-48b5-b287-30f932668f2c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:24.150091 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-f8e73a2b-f3b2-48b5-b287-30f932668f2c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:24.162752 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f8e73a2b-f3b2-48b5-b287-30f932668f2c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1290 microversion: 2.1 time: 0.214595 Oct 28 08:40:24.163353 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 45/89] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:23 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1290 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:24.260906 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-707edadc-3707-40e1-a1bc-5c02ef074376 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:24.261496 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-707edadc-3707-40e1-a1bc-5c02ef074376 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:24.274322 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-707edadc-3707-40e1-a1bc-5c02ef074376 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:24.274920 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-707edadc-3707-40e1-a1bc-5c02ef074376 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:24.276126 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-707edadc-3707-40e1-a1bc-5c02ef074376 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:24.276554 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-707edadc-3707-40e1-a1bc-5c02ef074376 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:24.333315 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-7a796135-07af-4ac2-8015-c079b6725e02 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:24.344196 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7a796135-07af-4ac2-8015-c079b6725e02 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.769383 Oct 28 08:40:24.359057 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 45/90] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:23 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:24.375811 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1b32d958-c4a8-4ee9-8b92-21cc4145d4df tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:24.379909 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1b32d958-c4a8-4ee9-8b92-21cc4145d4df tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:24.397210 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b32d958-c4a8-4ee9-8b92-21cc4145d4df tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:24.403739 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b32d958-c4a8-4ee9-8b92-21cc4145d4df tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:24.407377 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b32d958-c4a8-4ee9-8b92-21cc4145d4df tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:24.407831 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b32d958-c4a8-4ee9-8b92-21cc4145d4df tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:24.498984 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-707edadc-3707-40e1-a1bc-5c02ef074376 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:24.510090 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-707edadc-3707-40e1-a1bc-5c02ef074376 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:24.518800 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-707edadc-3707-40e1-a1bc-5c02ef074376 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:24.518800 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-707edadc-3707-40e1-a1bc-5c02ef074376 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1338 microversion: 2.20 time: 0.257328 Oct 28 08:40:24.533691 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 46/91] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:24 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1338 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:40:24.952891 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-97b0825b-0f09-4f15-88f6-5e9922383aa7 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:24.954014 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-97b0825b-0f09-4f15-88f6-5e9922383aa7 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:24.965279 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97b0825b-0f09-4f15-88f6-5e9922383aa7 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:24.969670 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97b0825b-0f09-4f15-88f6-5e9922383aa7 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:24.971201 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97b0825b-0f09-4f15-88f6-5e9922383aa7 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:24.971808 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97b0825b-0f09-4f15-88f6-5e9922383aa7 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:25.027633 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-1b32d958-c4a8-4ee9-8b92-21cc4145d4df tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:25.039774 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1b32d958-c4a8-4ee9-8b92-21cc4145d4df tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.675227 Oct 28 08:40:25.044509 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 46/92] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:24 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:25.182643 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0b2af55a-6ef4-428c-b1ad-3faf3712770a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:25.184160 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0b2af55a-6ef4-428c-b1ad-3faf3712770a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:25.196089 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b2af55a-6ef4-428c-b1ad-3faf3712770a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:25.198456 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b2af55a-6ef4-428c-b1ad-3faf3712770a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:25.202464 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b2af55a-6ef4-428c-b1ad-3faf3712770a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:25.204366 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b2af55a-6ef4-428c-b1ad-3faf3712770a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:25.344284 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-0b2af55a-6ef4-428c-b1ad-3faf3712770a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:25.353437 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0b2af55a-6ef4-428c-b1ad-3faf3712770a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1296 microversion: 2.1 time: 0.175599 Oct 28 08:40:25.356803 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 47/93] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:25 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1296 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:25.387938 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8c00680e-622d-421c-88b0-4897af6a6bd4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:25.388543 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8c00680e-622d-421c-88b0-4897af6a6bd4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:25.408371 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c00680e-622d-421c-88b0-4897af6a6bd4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:25.408820 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c00680e-622d-421c-88b0-4897af6a6bd4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:25.409587 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c00680e-622d-421c-88b0-4897af6a6bd4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:25.410013 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c00680e-622d-421c-88b0-4897af6a6bd4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:25.951789 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-97b0825b-0f09-4f15-88f6-5e9922383aa7 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:25.964276 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-97b0825b-0f09-4f15-88f6-5e9922383aa7 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 1.014426 Oct 28 08:40:25.964891 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 47/94] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:24 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:25.971987 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7495f278-231c-4cbb-a799-f3b7edf47b38 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:25.973188 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7495f278-231c-4cbb-a799-f3b7edf47b38 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:25.981303 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7495f278-231c-4cbb-a799-f3b7edf47b38 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:25.981748 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7495f278-231c-4cbb-a799-f3b7edf47b38 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:25.982760 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7495f278-231c-4cbb-a799-f3b7edf47b38 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:25.983252 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7495f278-231c-4cbb-a799-f3b7edf47b38 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:26.119788 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-7495f278-231c-4cbb-a799-f3b7edf47b38 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:26.134354 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-7495f278-231c-4cbb-a799-f3b7edf47b38 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:26.141224 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-7495f278-231c-4cbb-a799-f3b7edf47b38 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:26.142417 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7495f278-231c-4cbb-a799-f3b7edf47b38 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1338 microversion: 2.20 time: 0.176160 Oct 28 08:40:26.143282 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 48/95] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:25 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1338 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:40:26.155119 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4516ee3a-5f56-4145-bea6-50fc745ea4e4 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:26.155853 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4516ee3a-5f56-4145-bea6-50fc745ea4e4 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:26.177938 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4516ee3a-5f56-4145-bea6-50fc745ea4e4 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:26.178444 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4516ee3a-5f56-4145-bea6-50fc745ea4e4 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:26.180111 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4516ee3a-5f56-4145-bea6-50fc745ea4e4 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:26.180725 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4516ee3a-5f56-4145-bea6-50fc745ea4e4 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:26.308171 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-8c00680e-622d-421c-88b0-4897af6a6bd4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:26.316522 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8c00680e-622d-421c-88b0-4897af6a6bd4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.951178 Oct 28 08:40:26.317170 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 48/96] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:25 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:26.372033 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a615c4c0-c324-4f54-bccf-a762ac73c880 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:26.373127 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a615c4c0-c324-4f54-bccf-a762ac73c880 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:26.388035 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a615c4c0-c324-4f54-bccf-a762ac73c880 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:26.390774 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a615c4c0-c324-4f54-bccf-a762ac73c880 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:26.391676 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a615c4c0-c324-4f54-bccf-a762ac73c880 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:26.393400 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a615c4c0-c324-4f54-bccf-a762ac73c880 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:26.582482 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-4516ee3a-5f56-4145-bea6-50fc745ea4e4 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:26.590905 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4516ee3a-5f56-4145-bea6-50fc745ea4e4 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.446305 Oct 28 08:40:26.591980 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 49/97] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:26 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:26.650581 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-a615c4c0-c324-4f54-bccf-a762ac73c880 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:26.658426 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a615c4c0-c324-4f54-bccf-a762ac73c880 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1363 microversion: 2.1 time: 0.290696 Oct 28 08:40:26.660243 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 49/98] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:26 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1363 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:26.981341 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1fa86de4-56f3-4f6a-8349-a2a1b86e4103 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:26.981961 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1fa86de4-56f3-4f6a-8349-a2a1b86e4103 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:26.988482 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fa86de4-56f3-4f6a-8349-a2a1b86e4103 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:26.988892 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fa86de4-56f3-4f6a-8349-a2a1b86e4103 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:26.989795 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fa86de4-56f3-4f6a-8349-a2a1b86e4103 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:26.990217 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fa86de4-56f3-4f6a-8349-a2a1b86e4103 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:27.160522 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3c48eea6-76a5-4e34-a415-bd4233d96985 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:27.161468 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3c48eea6-76a5-4e34-a415-bd4233d96985 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:27.166173 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1fa86de4-56f3-4f6a-8349-a2a1b86e4103 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:27.167766 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c48eea6-76a5-4e34-a415-bd4233d96985 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:27.168281 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c48eea6-76a5-4e34-a415-bd4233d96985 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:27.169242 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c48eea6-76a5-4e34-a415-bd4233d96985 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:27.169640 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c48eea6-76a5-4e34-a415-bd4233d96985 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:27.174986 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1fa86de4-56f3-4f6a-8349-a2a1b86e4103 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.197159 Oct 28 08:40:27.175489 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 50/99] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:26 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:27.296140 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-3c48eea6-76a5-4e34-a415-bd4233d96985 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:27.307532 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-3c48eea6-76a5-4e34-a415-bd4233d96985 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:27.307532 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-3c48eea6-76a5-4e34-a415-bd4233d96985 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:27.308623 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3c48eea6-76a5-4e34-a415-bd4233d96985 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1406 microversion: 2.20 time: 0.152535 Oct 28 08:40:27.309172 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 50/100] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:27 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:40:27.333647 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ad260e6d-8660-4147-aba9-3c72f596e5ab tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:27.334253 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ad260e6d-8660-4147-aba9-3c72f596e5ab tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:27.339922 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad260e6d-8660-4147-aba9-3c72f596e5ab tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:27.340356 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad260e6d-8660-4147-aba9-3c72f596e5ab tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:27.341106 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad260e6d-8660-4147-aba9-3c72f596e5ab tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:27.341525 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad260e6d-8660-4147-aba9-3c72f596e5ab tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:27.478615 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-ad260e6d-8660-4147-aba9-3c72f596e5ab tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:27.490271 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ad260e6d-8660-4147-aba9-3c72f596e5ab tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.160248 Oct 28 08:40:27.490891 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 51/101] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:27 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:27.608927 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b52d426c-c72d-4edd-b322-ad4f68d87fc9 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:27.609832 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b52d426c-c72d-4edd-b322-ad4f68d87fc9 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:27.616309 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b52d426c-c72d-4edd-b322-ad4f68d87fc9 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:27.616758 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b52d426c-c72d-4edd-b322-ad4f68d87fc9 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:27.617525 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b52d426c-c72d-4edd-b322-ad4f68d87fc9 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:27.617959 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b52d426c-c72d-4edd-b322-ad4f68d87fc9 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:27.681331 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dfb87dab-d271-4c89-9f2b-a74b7807bf99 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:27.683177 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dfb87dab-d271-4c89-9f2b-a74b7807bf99 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:27.692104 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dfb87dab-d271-4c89-9f2b-a74b7807bf99 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:27.692770 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dfb87dab-d271-4c89-9f2b-a74b7807bf99 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:27.693548 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dfb87dab-d271-4c89-9f2b-a74b7807bf99 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:27.693974 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dfb87dab-d271-4c89-9f2b-a74b7807bf99 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:27.783205 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-b52d426c-c72d-4edd-b322-ad4f68d87fc9 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:27.791085 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b52d426c-c72d-4edd-b322-ad4f68d87fc9 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.185758 Oct 28 08:40:27.792123 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 51/102] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:27 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:27.843323 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-dfb87dab-d271-4c89-9f2b-a74b7807bf99 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:27.851136 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dfb87dab-d271-4c89-9f2b-a74b7807bf99 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1363 microversion: 2.1 time: 0.178200 Oct 28 08:40:27.851707 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 52/103] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:27 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:28.192287 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6ac9c108-34d3-4a8c-b24b-54eb2b18ed8d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:28.192896 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6ac9c108-34d3-4a8c-b24b-54eb2b18ed8d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:28.198545 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ac9c108-34d3-4a8c-b24b-54eb2b18ed8d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:28.198997 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ac9c108-34d3-4a8c-b24b-54eb2b18ed8d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:28.199764 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ac9c108-34d3-4a8c-b24b-54eb2b18ed8d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:28.200192 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ac9c108-34d3-4a8c-b24b-54eb2b18ed8d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:28.328360 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0c3d3585-0cd3-4596-bc66-5c7cc0d5980f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:28.329604 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0c3d3585-0cd3-4596-bc66-5c7cc0d5980f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:28.336327 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c3d3585-0cd3-4596-bc66-5c7cc0d5980f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:28.339091 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-6ac9c108-34d3-4a8c-b24b-54eb2b18ed8d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:28.346924 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c3d3585-0cd3-4596-bc66-5c7cc0d5980f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:28.347217 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6ac9c108-34d3-4a8c-b24b-54eb2b18ed8d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.158406 Oct 28 08:40:28.347766 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c3d3585-0cd3-4596-bc66-5c7cc0d5980f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:28.347900 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 52/104] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:28 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:28.349024 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c3d3585-0cd3-4596-bc66-5c7cc0d5980f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:28.479545 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-0c3d3585-0cd3-4596-bc66-5c7cc0d5980f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:28.488225 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-0c3d3585-0cd3-4596-bc66-5c7cc0d5980f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:28.489737 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-0c3d3585-0cd3-4596-bc66-5c7cc0d5980f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:28.493145 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0c3d3585-0cd3-4596-bc66-5c7cc0d5980f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1406 microversion: 2.20 time: 0.167109 Oct 28 08:40:28.493145 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 53/105] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:28 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:40:28.507894 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4069d9d5-9a29-47c3-91be-881945cf9227 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:28.508705 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4069d9d5-9a29-47c3-91be-881945cf9227 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:28.514395 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4069d9d5-9a29-47c3-91be-881945cf9227 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:28.514870 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4069d9d5-9a29-47c3-91be-881945cf9227 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:28.515705 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4069d9d5-9a29-47c3-91be-881945cf9227 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:28.516138 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4069d9d5-9a29-47c3-91be-881945cf9227 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:28.641024 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-4069d9d5-9a29-47c3-91be-881945cf9227 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:28.648674 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4069d9d5-9a29-47c3-91be-881945cf9227 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.144815 Oct 28 08:40:28.649236 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 53/106] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:28 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:28.807817 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fceaaf40-c241-4cab-9848-f13e72c446fc tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:28.808487 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fceaaf40-c241-4cab-9848-f13e72c446fc tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:28.814436 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fceaaf40-c241-4cab-9848-f13e72c446fc tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:28.814910 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fceaaf40-c241-4cab-9848-f13e72c446fc tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:28.815663 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fceaaf40-c241-4cab-9848-f13e72c446fc tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:28.816090 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fceaaf40-c241-4cab-9848-f13e72c446fc tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:28.868149 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e66fcbc0-da1b-4c31-a52c-4802907413d0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:28.868763 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e66fcbc0-da1b-4c31-a52c-4802907413d0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:28.876197 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e66fcbc0-da1b-4c31-a52c-4802907413d0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:28.876938 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e66fcbc0-da1b-4c31-a52c-4802907413d0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:28.877877 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e66fcbc0-da1b-4c31-a52c-4802907413d0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:28.878540 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e66fcbc0-da1b-4c31-a52c-4802907413d0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:28.983845 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-fceaaf40-c241-4cab-9848-f13e72c446fc tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:28.992262 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fceaaf40-c241-4cab-9848-f13e72c446fc tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.187979 Oct 28 08:40:28.992842 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 54/107] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:28 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:29.047278 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-e66fcbc0-da1b-4c31-a52c-4802907413d0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:29.055524 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e66fcbc0-da1b-4c31-a52c-4802907413d0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1363 microversion: 2.1 time: 0.190844 Oct 28 08:40:29.056572 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 54/108] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:28 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:29.364857 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-46de36bb-1df9-4c3c-9cc1-b97dcafc27e6 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:29.365439 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-46de36bb-1df9-4c3c-9cc1-b97dcafc27e6 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:29.372560 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46de36bb-1df9-4c3c-9cc1-b97dcafc27e6 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:29.373012 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46de36bb-1df9-4c3c-9cc1-b97dcafc27e6 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:29.374099 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46de36bb-1df9-4c3c-9cc1-b97dcafc27e6 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:29.374412 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46de36bb-1df9-4c3c-9cc1-b97dcafc27e6 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:29.508629 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-af3fe57f-1f27-4d70-8cc5-db9eade61837 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:29.509404 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-af3fe57f-1f27-4d70-8cc5-db9eade61837 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:29.515210 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af3fe57f-1f27-4d70-8cc5-db9eade61837 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:29.516951 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af3fe57f-1f27-4d70-8cc5-db9eade61837 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:29.517941 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af3fe57f-1f27-4d70-8cc5-db9eade61837 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:29.518599 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af3fe57f-1f27-4d70-8cc5-db9eade61837 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:29.653459 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-46de36bb-1df9-4c3c-9cc1-b97dcafc27e6 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:29.664232 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-46de36bb-1df9-4c3c-9cc1-b97dcafc27e6 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.303548 Oct 28 08:40:29.664983 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 55/109] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:29 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:29.678355 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e5608d11-c392-496d-b36e-760410d6fb99 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:29.679045 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e5608d11-c392-496d-b36e-760410d6fb99 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:29.685010 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5608d11-c392-496d-b36e-760410d6fb99 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:29.685453 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5608d11-c392-496d-b36e-760410d6fb99 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:29.686229 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5608d11-c392-496d-b36e-760410d6fb99 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:29.686680 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5608d11-c392-496d-b36e-760410d6fb99 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:29.816104 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-af3fe57f-1f27-4d70-8cc5-db9eade61837 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:29.825663 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-af3fe57f-1f27-4d70-8cc5-db9eade61837 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:29.827461 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-af3fe57f-1f27-4d70-8cc5-db9eade61837 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:29.828678 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-af3fe57f-1f27-4d70-8cc5-db9eade61837 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1406 microversion: 2.20 time: 0.323716 Oct 28 08:40:29.829391 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 55/110] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:29 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1406 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:40:29.944024 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-e5608d11-c392-496d-b36e-760410d6fb99 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:29.964579 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-20cfb4d9-0c5e-411b-876d-5cf61e1610c7 req-12826ab9-667d-4bfc-bf3a-da08ccbe1d34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "914cd123-e872-418a-bf38-f477fe1551b3", "tag": "bc82b34a-5083-4fe6-8ca3-57d3482a7509"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:29.970623 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:40:29.970623 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:40:29.971736 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e5608d11-c392-496d-b36e-760410d6fb99 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.296941 Oct 28 08:40:29.976011 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 56/111] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:29 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:29.983560 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-20cfb4d9-0c5e-411b-876d-5cf61e1610c7 req-12826ab9-667d-4bfc-bf3a-da08ccbe1d34 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:29.984293 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-20cfb4d9-0c5e-411b-876d-5cf61e1610c7 req-12826ab9-667d-4bfc-bf3a-da08ccbe1d34 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:29.997478 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-20cfb4d9-0c5e-411b-876d-5cf61e1610c7 req-12826ab9-667d-4bfc-bf3a-da08ccbe1d34 service nova] Creating event network-changed:bc82b34a-5083-4fe6-8ca3-57d3482a7509 for instance 914cd123-e872-418a-bf38-f477fe1551b3 on hv-cinder-81565 Oct 28 08:40:30.003791 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-20cfb4d9-0c5e-411b-876d-5cf61e1610c7 req-12826ab9-667d-4bfc-bf3a-da08ccbe1d34 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044549 Oct 28 08:40:30.004971 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 56/112] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:40:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:30.008947 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dbe6a1fa-e56d-431e-be7b-f8049b6b3390 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:30.009558 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dbe6a1fa-e56d-431e-be7b-f8049b6b3390 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:30.022523 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dbe6a1fa-e56d-431e-be7b-f8049b6b3390 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:30.023107 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dbe6a1fa-e56d-431e-be7b-f8049b6b3390 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:30.024083 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dbe6a1fa-e56d-431e-be7b-f8049b6b3390 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:30.027364 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dbe6a1fa-e56d-431e-be7b-f8049b6b3390 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:30.074231 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-097774a5-a0a2-4a7a-9572-7cf7d3303a5a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:30.075377 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-097774a5-a0a2-4a7a-9572-7cf7d3303a5a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:30.087324 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-097774a5-a0a2-4a7a-9572-7cf7d3303a5a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:30.087806 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-097774a5-a0a2-4a7a-9572-7cf7d3303a5a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:30.089167 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-097774a5-a0a2-4a7a-9572-7cf7d3303a5a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:30.089630 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-097774a5-a0a2-4a7a-9572-7cf7d3303a5a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:30.429839 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-dbe6a1fa-e56d-431e-be7b-f8049b6b3390 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:30.437508 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dbe6a1fa-e56d-431e-be7b-f8049b6b3390 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.431920 Oct 28 08:40:30.447961 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 57/113] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:30 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:30.505382 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-097774a5-a0a2-4a7a-9572-7cf7d3303a5a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:30.513418 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-097774a5-a0a2-4a7a-9572-7cf7d3303a5a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1363 microversion: 2.1 time: 0.443546 Oct 28 08:40:30.524315 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 57/114] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:30 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1363 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:30.580067 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-e337cba7-d05b-45da-950d-73e42a84a4dd req-2b001494-ba46-4e6a-b44d-f2683966ca85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e3ca69d-4e09-4205-b6ec-2a6189724e46", "tag": "b51a5869-7eac-401f-ad13-59a689851a50"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:30.582198 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:40:30.582198 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:40:30.596112 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e337cba7-d05b-45da-950d-73e42a84a4dd req-2b001494-ba46-4e6a-b44d-f2683966ca85 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:30.597185 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e337cba7-d05b-45da-950d-73e42a84a4dd req-2b001494-ba46-4e6a-b44d-f2683966ca85 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:30.618685 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e337cba7-d05b-45da-950d-73e42a84a4dd req-2b001494-ba46-4e6a-b44d-f2683966ca85 service nova] Creating event network-changed:b51a5869-7eac-401f-ad13-59a689851a50 for instance 4e3ca69d-4e09-4205-b6ec-2a6189724e46 on hv-cinder-81565 Oct 28 08:40:30.624623 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-e337cba7-d05b-45da-950d-73e42a84a4dd req-2b001494-ba46-4e6a-b44d-f2683966ca85 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052191 Oct 28 08:40:30.626190 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 58/115] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:40:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:30.681204 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ef382c65-ef19-42b2-a1fa-a2311272060d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:30.681863 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ef382c65-ef19-42b2-a1fa-a2311272060d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:30.688744 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef382c65-ef19-42b2-a1fa-a2311272060d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:30.689431 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef382c65-ef19-42b2-a1fa-a2311272060d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:30.690618 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef382c65-ef19-42b2-a1fa-a2311272060d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:30.691264 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef382c65-ef19-42b2-a1fa-a2311272060d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:30.847455 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8d9e9b32-6edc-48c1-8389-8602569eec0a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:30.848375 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8d9e9b32-6edc-48c1-8389-8602569eec0a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:30.860015 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d9e9b32-6edc-48c1-8389-8602569eec0a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:30.861123 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d9e9b32-6edc-48c1-8389-8602569eec0a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:30.862109 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d9e9b32-6edc-48c1-8389-8602569eec0a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:30.862777 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d9e9b32-6edc-48c1-8389-8602569eec0a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:30.903613 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-ef382c65-ef19-42b2-a1fa-a2311272060d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:30.915113 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ef382c65-ef19-42b2-a1fa-a2311272060d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.237678 Oct 28 08:40:30.915701 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 58/116] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:30 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:30.990604 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6c610278-2510-4fb7-81f8-e79f48e6943a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:30.991312 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6c610278-2510-4fb7-81f8-e79f48e6943a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:30.998089 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c610278-2510-4fb7-81f8-e79f48e6943a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:30.998564 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c610278-2510-4fb7-81f8-e79f48e6943a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:30.999344 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c610278-2510-4fb7-81f8-e79f48e6943a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:30.999796 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c610278-2510-4fb7-81f8-e79f48e6943a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:31.133570 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-8d9e9b32-6edc-48c1-8389-8602569eec0a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:31.142435 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-8d9e9b32-6edc-48c1-8389-8602569eec0a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:31.143968 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-8d9e9b32-6edc-48c1-8389-8602569eec0a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:31.145280 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8d9e9b32-6edc-48c1-8389-8602569eec0a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1406 microversion: 2.20 time: 0.302646 Oct 28 08:40:31.145843 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 59/117] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:30 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1406 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:40:31.420978 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-6c610278-2510-4fb7-81f8-e79f48e6943a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:31.431014 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6c610278-2510-4fb7-81f8-e79f48e6943a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.444870 Oct 28 08:40:31.431583 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 59/118] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:30 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:31.455263 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7ebe280a-d96d-4aa2-a6ea-935b784d29e7 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:31.456037 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7ebe280a-d96d-4aa2-a6ea-935b784d29e7 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:31.461969 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ebe280a-d96d-4aa2-a6ea-935b784d29e7 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:31.462412 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ebe280a-d96d-4aa2-a6ea-935b784d29e7 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:31.463191 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ebe280a-d96d-4aa2-a6ea-935b784d29e7 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:31.463605 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ebe280a-d96d-4aa2-a6ea-935b784d29e7 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:31.532784 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c56691e4-e467-4b98-a133-4f5c6857787e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:31.533388 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c56691e4-e467-4b98-a133-4f5c6857787e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:31.541473 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c56691e4-e467-4b98-a133-4f5c6857787e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:31.542011 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c56691e4-e467-4b98-a133-4f5c6857787e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:31.543005 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c56691e4-e467-4b98-a133-4f5c6857787e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:31.543723 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c56691e4-e467-4b98-a133-4f5c6857787e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:31.607959 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-7ebe280a-d96d-4aa2-a6ea-935b784d29e7 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:31.617357 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7ebe280a-d96d-4aa2-a6ea-935b784d29e7 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.165727 Oct 28 08:40:31.627639 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 60/119] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:31 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:31.721114 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c56691e4-e467-4b98-a133-4f5c6857787e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:31.738220 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c56691e4-e467-4b98-a133-4f5c6857787e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1363 microversion: 2.1 time: 0.209984 Oct 28 08:40:31.739040 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 60/120] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:31 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:31.932705 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-deed6e26-b6d4-4fde-becd-44c854a1e229 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:31.933302 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-deed6e26-b6d4-4fde-becd-44c854a1e229 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:31.939672 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-deed6e26-b6d4-4fde-becd-44c854a1e229 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:31.940108 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-deed6e26-b6d4-4fde-becd-44c854a1e229 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:31.940859 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-deed6e26-b6d4-4fde-becd-44c854a1e229 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:31.941286 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-deed6e26-b6d4-4fde-becd-44c854a1e229 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:32.066387 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-deed6e26-b6d4-4fde-becd-44c854a1e229 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:32.073533 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-deed6e26-b6d4-4fde-becd-44c854a1e229 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.144616 Oct 28 08:40:32.074097 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 61/121] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:31 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:32.163234 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5cd310a4-118b-4b39-9858-e326a34df991 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:32.163842 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5cd310a4-118b-4b39-9858-e326a34df991 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:32.169788 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5cd310a4-118b-4b39-9858-e326a34df991 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:32.170241 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5cd310a4-118b-4b39-9858-e326a34df991 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:32.171054 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5cd310a4-118b-4b39-9858-e326a34df991 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:32.171485 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5cd310a4-118b-4b39-9858-e326a34df991 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:32.302275 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-5cd310a4-118b-4b39-9858-e326a34df991 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:32.309936 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-5cd310a4-118b-4b39-9858-e326a34df991 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:32.311449 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-5cd310a4-118b-4b39-9858-e326a34df991 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:32.313095 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5cd310a4-118b-4b39-9858-e326a34df991 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1406 microversion: 2.20 time: 0.152990 Oct 28 08:40:32.313641 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 61/122] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:32 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:40:32.448386 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f404ef61-9eed-4438-9538-3b3b5acd207f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:32.448890 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f404ef61-9eed-4438-9538-3b3b5acd207f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:32.455928 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f404ef61-9eed-4438-9538-3b3b5acd207f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:32.456502 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f404ef61-9eed-4438-9538-3b3b5acd207f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:32.457090 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f404ef61-9eed-4438-9538-3b3b5acd207f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:32.457505 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f404ef61-9eed-4438-9538-3b3b5acd207f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:32.576753 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-f404ef61-9eed-4438-9538-3b3b5acd207f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:32.585103 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f404ef61-9eed-4438-9538-3b3b5acd207f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.140405 Oct 28 08:40:32.585692 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 62/123] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:32 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:32.634553 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1b14e0fd-64cd-4a0a-9b86-e865d658cd80 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:32.635164 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1b14e0fd-64cd-4a0a-9b86-e865d658cd80 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:32.641741 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b14e0fd-64cd-4a0a-9b86-e865d658cd80 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:32.642184 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b14e0fd-64cd-4a0a-9b86-e865d658cd80 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:32.642975 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b14e0fd-64cd-4a0a-9b86-e865d658cd80 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:32.643413 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b14e0fd-64cd-4a0a-9b86-e865d658cd80 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:32.756289 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8df0b0a2-ded6-41fa-bb0b-3aec931c302c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:32.757152 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8df0b0a2-ded6-41fa-bb0b-3aec931c302c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:32.763329 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8df0b0a2-ded6-41fa-bb0b-3aec931c302c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:32.763993 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8df0b0a2-ded6-41fa-bb0b-3aec931c302c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:32.764759 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8df0b0a2-ded6-41fa-bb0b-3aec931c302c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:32.765187 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8df0b0a2-ded6-41fa-bb0b-3aec931c302c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:32.768083 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-1b14e0fd-64cd-4a0a-9b86-e865d658cd80 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:32.775644 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1b14e0fd-64cd-4a0a-9b86-e865d658cd80 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.144748 Oct 28 08:40:32.776406 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 62/124] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:32 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:32.890492 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-8df0b0a2-ded6-41fa-bb0b-3aec931c302c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:32.897916 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8df0b0a2-ded6-41fa-bb0b-3aec931c302c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1363 microversion: 2.1 time: 0.145278 Oct 28 08:40:32.898485 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 63/125] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:32 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:33.091041 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-231f5dfc-00a0-4b0f-bac3-650446819edc tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:33.091651 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-231f5dfc-00a0-4b0f-bac3-650446819edc tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:33.098074 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-231f5dfc-00a0-4b0f-bac3-650446819edc tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:33.098758 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-231f5dfc-00a0-4b0f-bac3-650446819edc tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:33.099312 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-231f5dfc-00a0-4b0f-bac3-650446819edc tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:33.099746 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-231f5dfc-00a0-4b0f-bac3-650446819edc tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:33.220055 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-231f5dfc-00a0-4b0f-bac3-650446819edc tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:33.229101 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-231f5dfc-00a0-4b0f-bac3-650446819edc tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.141737 Oct 28 08:40:33.229662 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 63/126] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:33 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:33.332268 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f1f5121f-6245-49a8-9801-446456a0577e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:33.332853 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f1f5121f-6245-49a8-9801-446456a0577e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:33.338730 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1f5121f-6245-49a8-9801-446456a0577e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:33.339164 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1f5121f-6245-49a8-9801-446456a0577e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:33.339906 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1f5121f-6245-49a8-9801-446456a0577e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:33.340322 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1f5121f-6245-49a8-9801-446456a0577e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:33.465682 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-f1f5121f-6245-49a8-9801-446456a0577e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:33.473539 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-f1f5121f-6245-49a8-9801-446456a0577e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:33.475326 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-f1f5121f-6245-49a8-9801-446456a0577e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:33.476417 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f1f5121f-6245-49a8-9801-446456a0577e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1406 microversion: 2.20 time: 0.148945 Oct 28 08:40:33.476985 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 64/127] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:33 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:40:33.601183 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ad1c123f-4d49-4bd3-a030-304780c7c6e3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:33.601777 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ad1c123f-4d49-4bd3-a030-304780c7c6e3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:33.607631 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad1c123f-4d49-4bd3-a030-304780c7c6e3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:33.608070 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad1c123f-4d49-4bd3-a030-304780c7c6e3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:33.608825 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad1c123f-4d49-4bd3-a030-304780c7c6e3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:33.609892 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad1c123f-4d49-4bd3-a030-304780c7c6e3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:33.730572 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-ad1c123f-4d49-4bd3-a030-304780c7c6e3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:33.738528 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ad1c123f-4d49-4bd3-a030-304780c7c6e3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.141262 Oct 28 08:40:33.739131 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 64/128] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:33 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:33.792289 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5027c4d1-8e10-457f-8766-3e80863d31e4 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:33.792993 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5027c4d1-8e10-457f-8766-3e80863d31e4 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:33.799728 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5027c4d1-8e10-457f-8766-3e80863d31e4 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:33.800163 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5027c4d1-8e10-457f-8766-3e80863d31e4 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:33.800930 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5027c4d1-8e10-457f-8766-3e80863d31e4 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:33.801355 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5027c4d1-8e10-457f-8766-3e80863d31e4 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:33.918957 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ec8e9a1b-e1f5-44d8-8427-ac97fa9b46d7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:33.920084 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ec8e9a1b-e1f5-44d8-8427-ac97fa9b46d7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:33.933137 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec8e9a1b-e1f5-44d8-8427-ac97fa9b46d7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:33.933578 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec8e9a1b-e1f5-44d8-8427-ac97fa9b46d7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:33.934426 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec8e9a1b-e1f5-44d8-8427-ac97fa9b46d7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:33.934798 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec8e9a1b-e1f5-44d8-8427-ac97fa9b46d7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:33.937155 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-5027c4d1-8e10-457f-8766-3e80863d31e4 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:33.944242 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5027c4d1-8e10-457f-8766-3e80863d31e4 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.155609 Oct 28 08:40:33.944809 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 65/129] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:33 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:34.070260 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-ec8e9a1b-e1f5-44d8-8427-ac97fa9b46d7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:34.077512 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ec8e9a1b-e1f5-44d8-8427-ac97fa9b46d7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1363 microversion: 2.1 time: 0.165549 Oct 28 08:40:34.078132 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 65/130] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:33 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:34.245067 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f4a45154-5538-4039-8cde-5af745975de2 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:34.245578 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f4a45154-5538-4039-8cde-5af745975de2 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:34.251492 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4a45154-5538-4039-8cde-5af745975de2 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:34.251927 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4a45154-5538-4039-8cde-5af745975de2 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:34.252677 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4a45154-5538-4039-8cde-5af745975de2 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:34.253098 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4a45154-5538-4039-8cde-5af745975de2 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:34.379647 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-f4a45154-5538-4039-8cde-5af745975de2 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:34.386974 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f4a45154-5538-4039-8cde-5af745975de2 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.145563 Oct 28 08:40:34.387573 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 66/131] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:34 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:34.494545 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e7e1c5b8-8101-4246-b026-46af736bee09 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:34.495208 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e7e1c5b8-8101-4246-b026-46af736bee09 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:34.501150 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7e1c5b8-8101-4246-b026-46af736bee09 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:34.501711 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7e1c5b8-8101-4246-b026-46af736bee09 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:34.502468 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7e1c5b8-8101-4246-b026-46af736bee09 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:34.502925 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7e1c5b8-8101-4246-b026-46af736bee09 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:34.626364 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-e7e1c5b8-8101-4246-b026-46af736bee09 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:34.633917 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-e7e1c5b8-8101-4246-b026-46af736bee09 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:34.635422 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-e7e1c5b8-8101-4246-b026-46af736bee09 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:34.636500 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e7e1c5b8-8101-4246-b026-46af736bee09 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1406 microversion: 2.20 time: 0.145670 Oct 28 08:40:34.637044 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 66/132] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:34 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1406 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:40:34.755167 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-010c5273-51b2-40ae-9b75-9f5f6b89b6be tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:34.755703 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-010c5273-51b2-40ae-9b75-9f5f6b89b6be tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:34.761586 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-010c5273-51b2-40ae-9b75-9f5f6b89b6be tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:34.762019 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-010c5273-51b2-40ae-9b75-9f5f6b89b6be tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:34.762797 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-010c5273-51b2-40ae-9b75-9f5f6b89b6be tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:34.763221 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-010c5273-51b2-40ae-9b75-9f5f6b89b6be tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:34.891782 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-010c5273-51b2-40ae-9b75-9f5f6b89b6be tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:34.899200 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-010c5273-51b2-40ae-9b75-9f5f6b89b6be tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.147656 Oct 28 08:40:34.899766 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 67/133] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:34 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:34.960694 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-285ea5f4-666f-4499-8af7-89715e13cb41 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:34.961297 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-285ea5f4-666f-4499-8af7-89715e13cb41 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:34.966885 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-285ea5f4-666f-4499-8af7-89715e13cb41 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:34.967323 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-285ea5f4-666f-4499-8af7-89715e13cb41 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:34.968070 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-285ea5f4-666f-4499-8af7-89715e13cb41 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:34.969109 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-285ea5f4-666f-4499-8af7-89715e13cb41 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:35.089206 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-285ea5f4-666f-4499-8af7-89715e13cb41 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:35.095390 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9742c715-d124-4170-98f7-717c9ad549f9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:35.095938 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9742c715-d124-4170-98f7-717c9ad549f9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:35.097786 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-285ea5f4-666f-4499-8af7-89715e13cb41 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.140573 Oct 28 08:40:35.098780 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 67/134] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:34 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:35.102649 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9742c715-d124-4170-98f7-717c9ad549f9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:35.103097 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9742c715-d124-4170-98f7-717c9ad549f9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:35.103858 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9742c715-d124-4170-98f7-717c9ad549f9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:35.104370 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9742c715-d124-4170-98f7-717c9ad549f9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:35.224416 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-9742c715-d124-4170-98f7-717c9ad549f9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:35.231780 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9742c715-d124-4170-98f7-717c9ad549f9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1363 microversion: 2.1 time: 0.140747 Oct 28 08:40:35.232374 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 68/135] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:35 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1363 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:35.404186 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1f2b4d40-20d7-4fd8-8b2a-549ef2a7cade tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:35.404789 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1f2b4d40-20d7-4fd8-8b2a-549ef2a7cade tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:35.410639 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f2b4d40-20d7-4fd8-8b2a-549ef2a7cade tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:35.411083 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f2b4d40-20d7-4fd8-8b2a-549ef2a7cade tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:35.411836 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f2b4d40-20d7-4fd8-8b2a-549ef2a7cade tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:35.412261 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f2b4d40-20d7-4fd8-8b2a-549ef2a7cade tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:35.535183 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-1f2b4d40-20d7-4fd8-8b2a-549ef2a7cade tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:35.542342 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1f2b4d40-20d7-4fd8-8b2a-549ef2a7cade tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.141755 Oct 28 08:40:35.542936 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 68/136] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:35 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:35.657730 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-41ff4661-0f4d-4086-9e6a-76cb1701ac61 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:35.658253 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-41ff4661-0f4d-4086-9e6a-76cb1701ac61 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:35.664368 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41ff4661-0f4d-4086-9e6a-76cb1701ac61 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:35.664841 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41ff4661-0f4d-4086-9e6a-76cb1701ac61 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:35.665603 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41ff4661-0f4d-4086-9e6a-76cb1701ac61 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:35.666036 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41ff4661-0f4d-4086-9e6a-76cb1701ac61 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:35.793142 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-41ff4661-0f4d-4086-9e6a-76cb1701ac61 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:35.801735 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-41ff4661-0f4d-4086-9e6a-76cb1701ac61 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:35.803265 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-41ff4661-0f4d-4086-9e6a-76cb1701ac61 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:35.804428 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-41ff4661-0f4d-4086-9e6a-76cb1701ac61 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1406 microversion: 2.20 time: 0.154446 Oct 28 08:40:35.804984 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 69/137] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:35 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:40:35.916324 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-77e3f68d-fbf9-40fa-af9f-171ecd03eb6c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:35.917053 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-77e3f68d-fbf9-40fa-af9f-171ecd03eb6c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:35.924579 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77e3f68d-fbf9-40fa-af9f-171ecd03eb6c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:35.924991 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77e3f68d-fbf9-40fa-af9f-171ecd03eb6c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:35.927025 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77e3f68d-fbf9-40fa-af9f-171ecd03eb6c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:35.927025 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77e3f68d-fbf9-40fa-af9f-171ecd03eb6c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:36.055929 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-77e3f68d-fbf9-40fa-af9f-171ecd03eb6c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:36.063819 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-77e3f68d-fbf9-40fa-af9f-171ecd03eb6c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.151625 Oct 28 08:40:36.064448 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 69/138] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:35 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:36.115202 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1e7f1ff6-a04c-4428-bf45-b932a0b384b0 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:36.115808 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1e7f1ff6-a04c-4428-bf45-b932a0b384b0 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:36.121508 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e7f1ff6-a04c-4428-bf45-b932a0b384b0 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:36.121944 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e7f1ff6-a04c-4428-bf45-b932a0b384b0 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:36.122727 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e7f1ff6-a04c-4428-bf45-b932a0b384b0 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:36.123150 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e7f1ff6-a04c-4428-bf45-b932a0b384b0 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:36.247722 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e2ccb188-8a02-4352-8228-5155ba836369 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:36.248335 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e2ccb188-8a02-4352-8228-5155ba836369 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:36.250219 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1e7f1ff6-a04c-4428-bf45-b932a0b384b0 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:36.255318 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2ccb188-8a02-4352-8228-5155ba836369 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:36.255768 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2ccb188-8a02-4352-8228-5155ba836369 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:36.256531 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2ccb188-8a02-4352-8228-5155ba836369 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:36.256958 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2ccb188-8a02-4352-8228-5155ba836369 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:36.257831 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1e7f1ff6-a04c-4428-bf45-b932a0b384b0 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.146359 Oct 28 08:40:36.258398 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 70/139] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:36 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:36.379556 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-e2ccb188-8a02-4352-8228-5155ba836369 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:36.386754 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e2ccb188-8a02-4352-8228-5155ba836369 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1363 microversion: 2.1 time: 0.142629 Oct 28 08:40:36.387314 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 70/140] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:36 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1363 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:36.558550 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ee490bfa-de97-4a25-8343-c540812056ba tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:36.559153 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ee490bfa-de97-4a25-8343-c540812056ba tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:36.565735 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee490bfa-de97-4a25-8343-c540812056ba tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:36.566171 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee490bfa-de97-4a25-8343-c540812056ba tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:36.566950 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee490bfa-de97-4a25-8343-c540812056ba tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:36.567374 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee490bfa-de97-4a25-8343-c540812056ba tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:36.696398 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-ee490bfa-de97-4a25-8343-c540812056ba tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:36.707754 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ee490bfa-de97-4a25-8343-c540812056ba tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.152740 Oct 28 08:40:36.708328 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 71/141] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:36 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:36.823425 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-335fc008-9a38-41bc-ac35-2acbeb7fd4d9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:36.824050 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-335fc008-9a38-41bc-ac35-2acbeb7fd4d9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:36.830176 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-335fc008-9a38-41bc-ac35-2acbeb7fd4d9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:36.830659 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-335fc008-9a38-41bc-ac35-2acbeb7fd4d9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:36.831430 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-335fc008-9a38-41bc-ac35-2acbeb7fd4d9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:36.831856 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-335fc008-9a38-41bc-ac35-2acbeb7fd4d9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:36.966701 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-335fc008-9a38-41bc-ac35-2acbeb7fd4d9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:36.976515 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-335fc008-9a38-41bc-ac35-2acbeb7fd4d9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:36.978175 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-335fc008-9a38-41bc-ac35-2acbeb7fd4d9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:36.979369 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-335fc008-9a38-41bc-ac35-2acbeb7fd4d9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1406 microversion: 2.20 time: 0.159675 Oct 28 08:40:36.979908 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 71/142] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:36 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:40:37.081123 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8db92db5-b187-45fc-90a6-ad98ed3a1074 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:37.083552 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8db92db5-b187-45fc-90a6-ad98ed3a1074 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:37.091091 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8db92db5-b187-45fc-90a6-ad98ed3a1074 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:37.092247 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8db92db5-b187-45fc-90a6-ad98ed3a1074 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:37.093527 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8db92db5-b187-45fc-90a6-ad98ed3a1074 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:37.095177 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8db92db5-b187-45fc-90a6-ad98ed3a1074 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:37.223829 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-8db92db5-b187-45fc-90a6-ad98ed3a1074 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:37.231272 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8db92db5-b187-45fc-90a6-ad98ed3a1074 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.155016 Oct 28 08:40:37.231837 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 72/143] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:37 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:37.274876 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9cf9a07f-b6a7-4ce2-8c7d-111d9539d0f2 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:37.275476 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9cf9a07f-b6a7-4ce2-8c7d-111d9539d0f2 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:37.281955 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cf9a07f-b6a7-4ce2-8c7d-111d9539d0f2 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:37.282484 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cf9a07f-b6a7-4ce2-8c7d-111d9539d0f2 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:37.283368 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cf9a07f-b6a7-4ce2-8c7d-111d9539d0f2 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:37.283992 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cf9a07f-b6a7-4ce2-8c7d-111d9539d0f2 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:37.403353 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0bb19fb8-80be-4210-8f48-3f1ebaa9fa55 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:37.403988 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0bb19fb8-80be-4210-8f48-3f1ebaa9fa55 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:37.407264 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-9cf9a07f-b6a7-4ce2-8c7d-111d9539d0f2 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:37.409927 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bb19fb8-80be-4210-8f48-3f1ebaa9fa55 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:37.410372 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bb19fb8-80be-4210-8f48-3f1ebaa9fa55 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:37.411161 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bb19fb8-80be-4210-8f48-3f1ebaa9fa55 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:37.411588 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bb19fb8-80be-4210-8f48-3f1ebaa9fa55 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:37.414512 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9cf9a07f-b6a7-4ce2-8c7d-111d9539d0f2 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.143241 Oct 28 08:40:37.415080 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 72/144] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:37 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:37.541339 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-0bb19fb8-80be-4210-8f48-3f1ebaa9fa55 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:37.549289 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0bb19fb8-80be-4210-8f48-3f1ebaa9fa55 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1363 microversion: 2.1 time: 0.149478 Oct 28 08:40:37.549860 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 73/145] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:37 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:37.725730 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eaf9dffb-da1e-480d-8348-a2bb7aadb767 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:37.726240 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-eaf9dffb-da1e-480d-8348-a2bb7aadb767 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:37.732099 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eaf9dffb-da1e-480d-8348-a2bb7aadb767 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:37.732535 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eaf9dffb-da1e-480d-8348-a2bb7aadb767 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:37.733285 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eaf9dffb-da1e-480d-8348-a2bb7aadb767 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:37.733707 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eaf9dffb-da1e-480d-8348-a2bb7aadb767 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:37.855179 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-eaf9dffb-da1e-480d-8348-a2bb7aadb767 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:37.863965 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eaf9dffb-da1e-480d-8348-a2bb7aadb767 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.142156 Oct 28 08:40:37.864559 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 73/146] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:37 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:37.997045 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-86b70dd9-8f94-47b5-9add-2da03e857674 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:37.997545 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-86b70dd9-8f94-47b5-9add-2da03e857674 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:38.003895 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86b70dd9-8f94-47b5-9add-2da03e857674 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:38.004341 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86b70dd9-8f94-47b5-9add-2da03e857674 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:38.005134 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86b70dd9-8f94-47b5-9add-2da03e857674 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:38.005560 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86b70dd9-8f94-47b5-9add-2da03e857674 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:38.139380 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-86b70dd9-8f94-47b5-9add-2da03e857674 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:38.148349 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-86b70dd9-8f94-47b5-9add-2da03e857674 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:38.149950 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-86b70dd9-8f94-47b5-9add-2da03e857674 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:38.151204 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-86b70dd9-8f94-47b5-9add-2da03e857674 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1406 microversion: 2.20 time: 0.157956 Oct 28 08:40:38.151797 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 74/147] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:37 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:40:38.248510 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d88fe7cb-582c-4fd2-aebc-757e412ea2ef tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:38.249037 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d88fe7cb-582c-4fd2-aebc-757e412ea2ef tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:38.255091 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d88fe7cb-582c-4fd2-aebc-757e412ea2ef tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:38.255611 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d88fe7cb-582c-4fd2-aebc-757e412ea2ef tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:38.256384 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d88fe7cb-582c-4fd2-aebc-757e412ea2ef tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:38.256809 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d88fe7cb-582c-4fd2-aebc-757e412ea2ef tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:38.409455 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-d88fe7cb-582c-4fd2-aebc-757e412ea2ef tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:38.418182 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d88fe7cb-582c-4fd2-aebc-757e412ea2ef tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.173392 Oct 28 08:40:38.419450 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 74/148] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:38 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:38.430923 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-344efa8a-328a-474e-b9dc-413b5e105f45 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:38.431527 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-344efa8a-328a-474e-b9dc-413b5e105f45 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:38.438793 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-344efa8a-328a-474e-b9dc-413b5e105f45 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:38.439310 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-344efa8a-328a-474e-b9dc-413b5e105f45 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:38.440084 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-344efa8a-328a-474e-b9dc-413b5e105f45 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:38.440514 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-344efa8a-328a-474e-b9dc-413b5e105f45 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:38.565714 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0c1a5d81-5437-439c-8184-65dbfc5176a6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:38.566331 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0c1a5d81-5437-439c-8184-65dbfc5176a6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:38.566919 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-344efa8a-328a-474e-b9dc-413b5e105f45 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:38.572330 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c1a5d81-5437-439c-8184-65dbfc5176a6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:38.572772 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c1a5d81-5437-439c-8184-65dbfc5176a6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:38.573534 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c1a5d81-5437-439c-8184-65dbfc5176a6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:38.574154 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c1a5d81-5437-439c-8184-65dbfc5176a6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:38.574805 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-344efa8a-328a-474e-b9dc-413b5e105f45 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.147746 Oct 28 08:40:38.575459 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 75/149] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:38 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:38.707614 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-0c1a5d81-5437-439c-8184-65dbfc5176a6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:38.714844 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0c1a5d81-5437-439c-8184-65dbfc5176a6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1363 microversion: 2.1 time: 0.153635 Oct 28 08:40:38.715447 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 75/150] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:38 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:38.882057 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-67565f00-4577-4027-9b7d-fb5cc423c6c8 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:38.882991 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-67565f00-4577-4027-9b7d-fb5cc423c6c8 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:38.890077 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67565f00-4577-4027-9b7d-fb5cc423c6c8 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:38.890573 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67565f00-4577-4027-9b7d-fb5cc423c6c8 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:38.891506 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67565f00-4577-4027-9b7d-fb5cc423c6c8 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:38.892010 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67565f00-4577-4027-9b7d-fb5cc423c6c8 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:39.026361 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-67565f00-4577-4027-9b7d-fb5cc423c6c8 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:39.034389 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-67565f00-4577-4027-9b7d-fb5cc423c6c8 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.156504 Oct 28 08:40:39.035075 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 76/151] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:38 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:39.169316 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b22a4111-2609-4da1-bd74-28094fa5e5a8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:39.169854 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b22a4111-2609-4da1-bd74-28094fa5e5a8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:39.176387 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b22a4111-2609-4da1-bd74-28094fa5e5a8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:39.176827 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b22a4111-2609-4da1-bd74-28094fa5e5a8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:39.177581 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b22a4111-2609-4da1-bd74-28094fa5e5a8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:39.178002 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b22a4111-2609-4da1-bd74-28094fa5e5a8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:39.302729 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-b22a4111-2609-4da1-bd74-28094fa5e5a8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:39.310354 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-b22a4111-2609-4da1-bd74-28094fa5e5a8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:39.311895 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-b22a4111-2609-4da1-bd74-28094fa5e5a8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:39.313068 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b22a4111-2609-4da1-bd74-28094fa5e5a8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1406 microversion: 2.20 time: 0.147776 Oct 28 08:40:39.313619 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 76/152] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:39 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1406 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:40:39.436145 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dc937bd8-f6b5-44b8-9de5-a80edbd6abd3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:39.436666 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dc937bd8-f6b5-44b8-9de5-a80edbd6abd3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:39.443946 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc937bd8-f6b5-44b8-9de5-a80edbd6abd3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:39.444861 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc937bd8-f6b5-44b8-9de5-a80edbd6abd3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:39.445810 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc937bd8-f6b5-44b8-9de5-a80edbd6abd3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:39.446617 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc937bd8-f6b5-44b8-9de5-a80edbd6abd3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:39.595783 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a4e65352-91b5-4c85-985a-95207dfa1221 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:39.597042 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a4e65352-91b5-4c85-985a-95207dfa1221 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:39.607441 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4e65352-91b5-4c85-985a-95207dfa1221 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:39.608179 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4e65352-91b5-4c85-985a-95207dfa1221 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:39.609389 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4e65352-91b5-4c85-985a-95207dfa1221 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:39.610425 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4e65352-91b5-4c85-985a-95207dfa1221 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:39.621466 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-dc937bd8-f6b5-44b8-9de5-a80edbd6abd3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:39.631126 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dc937bd8-f6b5-44b8-9de5-a80edbd6abd3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.198534 Oct 28 08:40:39.632319 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 77/153] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:39 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:39.732891 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8047a372-c748-46b4-b8bc-6db14299132d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:39.734204 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8047a372-c748-46b4-b8bc-6db14299132d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:39.741369 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8047a372-c748-46b4-b8bc-6db14299132d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:39.742117 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8047a372-c748-46b4-b8bc-6db14299132d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:39.743352 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8047a372-c748-46b4-b8bc-6db14299132d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:39.744085 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8047a372-c748-46b4-b8bc-6db14299132d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:39.754736 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-a4e65352-91b5-4c85-985a-95207dfa1221 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:39.762246 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a4e65352-91b5-4c85-985a-95207dfa1221 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.173569 Oct 28 08:40:39.763223 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 77/154] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:39 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:39.881933 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-8047a372-c748-46b4-b8bc-6db14299132d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:39.889325 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8047a372-c748-46b4-b8bc-6db14299132d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1363 microversion: 2.1 time: 0.161162 Oct 28 08:40:39.889888 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 78/155] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:39 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:40.051758 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1204597e-b6fe-415f-b1dd-2541007ca68f tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:40.052362 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1204597e-b6fe-415f-b1dd-2541007ca68f tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:40.058158 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1204597e-b6fe-415f-b1dd-2541007ca68f tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:40.058645 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1204597e-b6fe-415f-b1dd-2541007ca68f tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:40.059405 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1204597e-b6fe-415f-b1dd-2541007ca68f tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:40.059922 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1204597e-b6fe-415f-b1dd-2541007ca68f tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:40.185300 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-1204597e-b6fe-415f-b1dd-2541007ca68f tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:40.193222 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1204597e-b6fe-415f-b1dd-2541007ca68f tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.145212 Oct 28 08:40:40.193801 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 78/156] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:40 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:40.331110 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a000de2b-dc75-4dba-90d8-3e5d4c9a2625 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:40.331803 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a000de2b-dc75-4dba-90d8-3e5d4c9a2625 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:40.337742 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a000de2b-dc75-4dba-90d8-3e5d4c9a2625 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:40.338187 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a000de2b-dc75-4dba-90d8-3e5d4c9a2625 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:40.338977 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a000de2b-dc75-4dba-90d8-3e5d4c9a2625 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:40.339424 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a000de2b-dc75-4dba-90d8-3e5d4c9a2625 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:40.466170 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-a000de2b-dc75-4dba-90d8-3e5d4c9a2625 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:40.478736 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-a000de2b-dc75-4dba-90d8-3e5d4c9a2625 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:40.480826 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-a000de2b-dc75-4dba-90d8-3e5d4c9a2625 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:40.481555 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a000de2b-dc75-4dba-90d8-3e5d4c9a2625 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1406 microversion: 2.20 time: 0.154426 Oct 28 08:40:40.482201 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 79/157] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:40 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:40:40.649107 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c4068062-5e6f-48d4-a2f1-e3229d3f7b9d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:40.649715 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c4068062-5e6f-48d4-a2f1-e3229d3f7b9d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:40.656612 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4068062-5e6f-48d4-a2f1-e3229d3f7b9d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:40.657350 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4068062-5e6f-48d4-a2f1-e3229d3f7b9d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:40.658202 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4068062-5e6f-48d4-a2f1-e3229d3f7b9d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:40.658665 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4068062-5e6f-48d4-a2f1-e3229d3f7b9d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:40.783741 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ad01bb38-3e82-49bc-a5b5-1d838a853345 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:40.784672 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ad01bb38-3e82-49bc-a5b5-1d838a853345 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:40.791274 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad01bb38-3e82-49bc-a5b5-1d838a853345 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:40.792066 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad01bb38-3e82-49bc-a5b5-1d838a853345 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:40.793059 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad01bb38-3e82-49bc-a5b5-1d838a853345 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:40.793709 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad01bb38-3e82-49bc-a5b5-1d838a853345 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:40.832906 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c4068062-5e6f-48d4-a2f1-e3229d3f7b9d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:40.854593 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c4068062-5e6f-48d4-a2f1-e3229d3f7b9d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.202654 Oct 28 08:40:40.864255 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 79/158] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:40 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:40.912086 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-381642f5-1187-4d4e-8008-a70af8f92b29 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:40.912713 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-381642f5-1187-4d4e-8008-a70af8f92b29 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:40.919561 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-381642f5-1187-4d4e-8008-a70af8f92b29 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:40.919999 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-381642f5-1187-4d4e-8008-a70af8f92b29 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:40.927534 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-381642f5-1187-4d4e-8008-a70af8f92b29 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:40.929296 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-381642f5-1187-4d4e-8008-a70af8f92b29 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:40.991918 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-ad01bb38-3e82-49bc-a5b5-1d838a853345 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:41.004069 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ad01bb38-3e82-49bc-a5b5-1d838a853345 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.223961 Oct 28 08:40:41.004069 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 80/159] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:40 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:41.119838 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-381642f5-1187-4d4e-8008-a70af8f92b29 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:41.128843 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-381642f5-1187-4d4e-8008-a70af8f92b29 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1363 microversion: 2.1 time: 0.225594 Oct 28 08:40:41.129437 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 80/160] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:40 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:41.209839 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dc022711-64e3-4085-af4e-6c9cbe173b88 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:41.210457 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dc022711-64e3-4085-af4e-6c9cbe173b88 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:41.216215 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc022711-64e3-4085-af4e-6c9cbe173b88 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:41.216668 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc022711-64e3-4085-af4e-6c9cbe173b88 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:41.217423 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc022711-64e3-4085-af4e-6c9cbe173b88 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:41.217850 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc022711-64e3-4085-af4e-6c9cbe173b88 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:41.339310 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-dc022711-64e3-4085-af4e-6c9cbe173b88 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:41.346551 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dc022711-64e3-4085-af4e-6c9cbe173b88 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.140486 Oct 28 08:40:41.347120 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 81/161] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:41 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:41.501262 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-40ee851b-acd0-4477-80c8-e9ad883361e8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:41.501776 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-40ee851b-acd0-4477-80c8-e9ad883361e8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:41.507696 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40ee851b-acd0-4477-80c8-e9ad883361e8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:41.508139 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40ee851b-acd0-4477-80c8-e9ad883361e8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:41.508901 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40ee851b-acd0-4477-80c8-e9ad883361e8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:41.509332 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40ee851b-acd0-4477-80c8-e9ad883361e8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:41.627701 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-40ee851b-acd0-4477-80c8-e9ad883361e8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:41.635369 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-40ee851b-acd0-4477-80c8-e9ad883361e8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:41.636883 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-40ee851b-acd0-4477-80c8-e9ad883361e8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:41.637996 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-40ee851b-acd0-4477-80c8-e9ad883361e8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1406 microversion: 2.20 time: 0.141360 Oct 28 08:40:41.638574 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 81/162] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:41 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1406 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:40:41.871159 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4074e3df-850f-4b80-9a51-33767ed34802 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:41.871735 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4074e3df-850f-4b80-9a51-33767ed34802 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:41.878274 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4074e3df-850f-4b80-9a51-33767ed34802 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:41.878748 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4074e3df-850f-4b80-9a51-33767ed34802 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:41.879506 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4074e3df-850f-4b80-9a51-33767ed34802 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:41.879932 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4074e3df-850f-4b80-9a51-33767ed34802 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:42.005122 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-4074e3df-850f-4b80-9a51-33767ed34802 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:42.013267 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4074e3df-850f-4b80-9a51-33767ed34802 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.145819 Oct 28 08:40:42.014043 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 82/163] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:41 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:42.021961 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3cc86c0f-1c63-4f13-ba32-548da93bc22d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:42.023913 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3cc86c0f-1c63-4f13-ba32-548da93bc22d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:42.030343 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cc86c0f-1c63-4f13-ba32-548da93bc22d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:42.030658 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cc86c0f-1c63-4f13-ba32-548da93bc22d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:42.032239 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cc86c0f-1c63-4f13-ba32-548da93bc22d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:42.034094 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cc86c0f-1c63-4f13-ba32-548da93bc22d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:42.145981 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3e59a322-0dab-49d3-ba02-a595901f63b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:42.146808 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3e59a322-0dab-49d3-ba02-a595901f63b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:42.158062 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e59a322-0dab-49d3-ba02-a595901f63b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:42.158592 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e59a322-0dab-49d3-ba02-a595901f63b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:42.159423 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e59a322-0dab-49d3-ba02-a595901f63b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:42.159919 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e59a322-0dab-49d3-ba02-a595901f63b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:42.190316 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-3cc86c0f-1c63-4f13-ba32-548da93bc22d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:42.199551 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3cc86c0f-1c63-4f13-ba32-548da93bc22d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.181912 Oct 28 08:40:42.212429 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 82/164] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:42 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:42.365705 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e3a7a1f8-9be2-4116-81e9-55fdc642d433 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:42.366525 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e3a7a1f8-9be2-4116-81e9-55fdc642d433 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:42.376184 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3a7a1f8-9be2-4116-81e9-55fdc642d433 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:42.378456 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3a7a1f8-9be2-4116-81e9-55fdc642d433 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:42.379829 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3a7a1f8-9be2-4116-81e9-55fdc642d433 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:42.383421 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3a7a1f8-9be2-4116-81e9-55fdc642d433 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:42.446968 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3e59a322-0dab-49d3-ba02-a595901f63b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:42.454610 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3e59a322-0dab-49d3-ba02-a595901f63b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1363 microversion: 2.1 time: 0.311880 Oct 28 08:40:42.458324 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 83/165] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:42 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:42.574845 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-e3a7a1f8-9be2-4116-81e9-55fdc642d433 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:42.583960 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e3a7a1f8-9be2-4116-81e9-55fdc642d433 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.222781 Oct 28 08:40:42.594895 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 83/166] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:42 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:42.658390 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0a4c9cd2-3cbc-4b60-a67b-5e3253bc227b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:42.659523 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0a4c9cd2-3cbc-4b60-a67b-5e3253bc227b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:42.666025 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a4c9cd2-3cbc-4b60-a67b-5e3253bc227b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:42.666780 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a4c9cd2-3cbc-4b60-a67b-5e3253bc227b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:42.667914 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a4c9cd2-3cbc-4b60-a67b-5e3253bc227b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:42.668891 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a4c9cd2-3cbc-4b60-a67b-5e3253bc227b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:42.859664 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-0a4c9cd2-3cbc-4b60-a67b-5e3253bc227b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:42.867690 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-0a4c9cd2-3cbc-4b60-a67b-5e3253bc227b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:42.869264 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-0a4c9cd2-3cbc-4b60-a67b-5e3253bc227b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:42.870637 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0a4c9cd2-3cbc-4b60-a67b-5e3253bc227b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1406 microversion: 2.20 time: 0.216638 Oct 28 08:40:42.871219 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 84/167] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:42 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:40:42.960360 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-28ffa7fc-b25b-419c-8656-9cce535f6a52 req-34d6f3a4-e6b1-4c8c-81f9-bad1d63a387d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a432ca47-c48c-4e08-8b76-0025d9ef360b", "name": "network-vif-plugged", "status": "completed", "tag": "62e8969b-1684-48c9-a697-1e36b8bae48e"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:42.961920 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:40:42.961920 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:40:42.975492 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-28ffa7fc-b25b-419c-8656-9cce535f6a52 req-34d6f3a4-e6b1-4c8c-81f9-bad1d63a387d service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:42.975929 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-28ffa7fc-b25b-419c-8656-9cce535f6a52 req-34d6f3a4-e6b1-4c8c-81f9-bad1d63a387d service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:42.987807 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-28ffa7fc-b25b-419c-8656-9cce535f6a52 req-34d6f3a4-e6b1-4c8c-81f9-bad1d63a387d service nova] Creating event network-vif-plugged:62e8969b-1684-48c9-a697-1e36b8bae48e for instance a432ca47-c48c-4e08-8b76-0025d9ef360b on hv-cinder-81565 Oct 28 08:40:42.992770 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-28ffa7fc-b25b-419c-8656-9cce535f6a52 req-34d6f3a4-e6b1-4c8c-81f9-bad1d63a387d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098012 Oct 28 08:40:42.993558 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 84/168] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:40:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:40:43.032169 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d25e1f24-fe3a-4d70-b369-99ca268e1e02 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:43.033069 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d25e1f24-fe3a-4d70-b369-99ca268e1e02 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:43.040277 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d25e1f24-fe3a-4d70-b369-99ca268e1e02 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:43.040713 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d25e1f24-fe3a-4d70-b369-99ca268e1e02 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:43.041694 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d25e1f24-fe3a-4d70-b369-99ca268e1e02 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:43.042306 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d25e1f24-fe3a-4d70-b369-99ca268e1e02 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:43.180559 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-d25e1f24-fe3a-4d70-b369-99ca268e1e02 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:43.189031 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d25e1f24-fe3a-4d70-b369-99ca268e1e02 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.162563 Oct 28 08:40:43.189874 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 85/169] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:43 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:43.221725 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-85039e1f-b3bd-42d5-bb64-484be3ce9f15 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:43.223410 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-85039e1f-b3bd-42d5-bb64-484be3ce9f15 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:43.232348 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85039e1f-b3bd-42d5-bb64-484be3ce9f15 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:43.233024 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85039e1f-b3bd-42d5-bb64-484be3ce9f15 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:43.233794 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85039e1f-b3bd-42d5-bb64-484be3ce9f15 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:43.234633 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85039e1f-b3bd-42d5-bb64-484be3ce9f15 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:43.413706 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-85039e1f-b3bd-42d5-bb64-484be3ce9f15 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:43.440091 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-85039e1f-b3bd-42d5-bb64-484be3ce9f15 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.225590 Oct 28 08:40:43.440698 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 85/170] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:43 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:43.475270 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6d81a2d3-c9d0-4fba-aff6-304f9b85268e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:43.475903 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6d81a2d3-c9d0-4fba-aff6-304f9b85268e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:43.481723 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d81a2d3-c9d0-4fba-aff6-304f9b85268e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:43.482173 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d81a2d3-c9d0-4fba-aff6-304f9b85268e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:43.482981 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d81a2d3-c9d0-4fba-aff6-304f9b85268e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:43.483409 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d81a2d3-c9d0-4fba-aff6-304f9b85268e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:43.605908 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-439d5fd2-f354-4d39-b551-8ad307024f22 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:43.606800 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-439d5fd2-f354-4d39-b551-8ad307024f22 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:43.620946 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-439d5fd2-f354-4d39-b551-8ad307024f22 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:43.621625 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-439d5fd2-f354-4d39-b551-8ad307024f22 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:43.622380 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-6d81a2d3-c9d0-4fba-aff6-304f9b85268e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:43.624037 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-439d5fd2-f354-4d39-b551-8ad307024f22 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:43.625509 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-439d5fd2-f354-4d39-b551-8ad307024f22 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:43.633396 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6d81a2d3-c9d0-4fba-aff6-304f9b85268e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1363 microversion: 2.1 time: 0.162077 Oct 28 08:40:43.634000 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 86/171] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:43 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:43.761012 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-439d5fd2-f354-4d39-b551-8ad307024f22 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:43.770102 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-439d5fd2-f354-4d39-b551-8ad307024f22 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.171470 Oct 28 08:40:43.779901 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 86/172] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:43 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:43.888863 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-55c83a97-6b47-4e7b-8eb0-8a23d60bf3b2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:43.889464 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-55c83a97-6b47-4e7b-8eb0-8a23d60bf3b2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:43.896100 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55c83a97-6b47-4e7b-8eb0-8a23d60bf3b2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:43.896541 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55c83a97-6b47-4e7b-8eb0-8a23d60bf3b2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:43.897310 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55c83a97-6b47-4e7b-8eb0-8a23d60bf3b2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:43.897739 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55c83a97-6b47-4e7b-8eb0-8a23d60bf3b2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:44.030678 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-55c83a97-6b47-4e7b-8eb0-8a23d60bf3b2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:44.039702 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-55c83a97-6b47-4e7b-8eb0-8a23d60bf3b2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:44.041175 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-55c83a97-6b47-4e7b-8eb0-8a23d60bf3b2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:44.042261 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-55c83a97-6b47-4e7b-8eb0-8a23d60bf3b2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1406 microversion: 2.20 time: 0.157070 Oct 28 08:40:44.042836 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 87/173] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:43 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:40:44.205277 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cf84c197-6f9a-4c10-b25d-405873092ac5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:44.205870 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cf84c197-6f9a-4c10-b25d-405873092ac5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:44.211587 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf84c197-6f9a-4c10-b25d-405873092ac5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:44.212022 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf84c197-6f9a-4c10-b25d-405873092ac5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:44.212760 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf84c197-6f9a-4c10-b25d-405873092ac5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:44.213176 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf84c197-6f9a-4c10-b25d-405873092ac5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:44.335412 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-cf84c197-6f9a-4c10-b25d-405873092ac5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:44.342902 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cf84c197-6f9a-4c10-b25d-405873092ac5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.141501 Oct 28 08:40:44.343951 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 87/174] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:44 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:44.456559 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2e3b8d30-a9ae-45c6-a8ef-7a86031887e6 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:44.457149 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2e3b8d30-a9ae-45c6-a8ef-7a86031887e6 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:44.463479 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e3b8d30-a9ae-45c6-a8ef-7a86031887e6 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:44.463910 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e3b8d30-a9ae-45c6-a8ef-7a86031887e6 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:44.464648 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e3b8d30-a9ae-45c6-a8ef-7a86031887e6 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:44.465062 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e3b8d30-a9ae-45c6-a8ef-7a86031887e6 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:44.587075 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-2e3b8d30-a9ae-45c6-a8ef-7a86031887e6 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:44.595205 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2e3b8d30-a9ae-45c6-a8ef-7a86031887e6 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.142567 Oct 28 08:40:44.595763 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 88/175] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:44 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:44.650542 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3ec6b149-76a3-480b-81e2-503e129cdd7c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:44.651145 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3ec6b149-76a3-480b-81e2-503e129cdd7c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:44.658159 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ec6b149-76a3-480b-81e2-503e129cdd7c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:44.658636 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ec6b149-76a3-480b-81e2-503e129cdd7c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:44.659411 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ec6b149-76a3-480b-81e2-503e129cdd7c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:44.659831 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ec6b149-76a3-480b-81e2-503e129cdd7c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:44.784273 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-3ec6b149-76a3-480b-81e2-503e129cdd7c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:44.788125 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ab3fff39-a7b6-4bfd-acd5-05a7e3797e76 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:44.788858 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ab3fff39-a7b6-4bfd-acd5-05a7e3797e76 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:44.794008 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3ec6b149-76a3-480b-81e2-503e129cdd7c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1363 microversion: 2.1 time: 0.146875 Oct 28 08:40:44.794572 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 88/176] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:44 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:44.796319 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab3fff39-a7b6-4bfd-acd5-05a7e3797e76 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:44.796857 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab3fff39-a7b6-4bfd-acd5-05a7e3797e76 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:44.797918 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab3fff39-a7b6-4bfd-acd5-05a7e3797e76 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:44.798284 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab3fff39-a7b6-4bfd-acd5-05a7e3797e76 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:44.925171 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-ab3fff39-a7b6-4bfd-acd5-05a7e3797e76 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:44.932661 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ab3fff39-a7b6-4bfd-acd5-05a7e3797e76 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.148374 Oct 28 08:40:44.933363 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 89/177] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:44 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:45.060129 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c0e24d01-4167-4317-95f9-e9de4b04590f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:45.060717 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c0e24d01-4167-4317-95f9-e9de4b04590f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:45.067744 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0e24d01-4167-4317-95f9-e9de4b04590f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:45.068287 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0e24d01-4167-4317-95f9-e9de4b04590f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:45.069151 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0e24d01-4167-4317-95f9-e9de4b04590f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:45.069840 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0e24d01-4167-4317-95f9-e9de4b04590f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:45.200223 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c0e24d01-4167-4317-95f9-e9de4b04590f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:45.209007 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c0e24d01-4167-4317-95f9-e9de4b04590f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:45.210552 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c0e24d01-4167-4317-95f9-e9de4b04590f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:45.211638 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c0e24d01-4167-4317-95f9-e9de4b04590f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1406 microversion: 2.20 time: 0.155203 Oct 28 08:40:45.212197 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 89/178] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:45 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:40:45.361508 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-25303f38-a46c-4411-853a-a750658cadeb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:45.362012 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-25303f38-a46c-4411-853a-a750658cadeb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:45.368265 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25303f38-a46c-4411-853a-a750658cadeb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:45.368704 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25303f38-a46c-4411-853a-a750658cadeb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:45.369464 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25303f38-a46c-4411-853a-a750658cadeb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:45.369884 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25303f38-a46c-4411-853a-a750658cadeb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:45.500893 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-25303f38-a46c-4411-853a-a750658cadeb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:45.509279 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-25303f38-a46c-4411-853a-a750658cadeb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.151902 Oct 28 08:40:45.509843 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 90/179] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:45 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:45.612403 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-58fbd463-ad2b-43cb-bddf-996326825915 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:45.612909 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-58fbd463-ad2b-43cb-bddf-996326825915 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:45.619166 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58fbd463-ad2b-43cb-bddf-996326825915 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:45.619613 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58fbd463-ad2b-43cb-bddf-996326825915 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:45.620386 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58fbd463-ad2b-43cb-bddf-996326825915 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:45.620813 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58fbd463-ad2b-43cb-bddf-996326825915 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:45.748704 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-58fbd463-ad2b-43cb-bddf-996326825915 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:45.756906 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-58fbd463-ad2b-43cb-bddf-996326825915 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.148922 Oct 28 08:40:45.757474 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 90/180] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:45 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:45.811489 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6b1169d9-dfac-4a72-9e4a-a1134bc3fc90 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:45.812088 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6b1169d9-dfac-4a72-9e4a-a1134bc3fc90 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:45.818517 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b1169d9-dfac-4a72-9e4a-a1134bc3fc90 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:45.818990 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b1169d9-dfac-4a72-9e4a-a1134bc3fc90 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:45.819747 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b1169d9-dfac-4a72-9e4a-a1134bc3fc90 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:45.820176 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b1169d9-dfac-4a72-9e4a-a1134bc3fc90 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:45.948992 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f1fae68b-1b36-4af3-a442-0f3d0e5b2722 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:45.949599 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f1fae68b-1b36-4af3-a442-0f3d0e5b2722 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:45.955772 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-6b1169d9-dfac-4a72-9e4a-a1134bc3fc90 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:45.956512 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1fae68b-1b36-4af3-a442-0f3d0e5b2722 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:45.957459 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1fae68b-1b36-4af3-a442-0f3d0e5b2722 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:45.958283 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1fae68b-1b36-4af3-a442-0f3d0e5b2722 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:45.958737 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1fae68b-1b36-4af3-a442-0f3d0e5b2722 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:45.965182 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6b1169d9-dfac-4a72-9e4a-a1134bc3fc90 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1363 microversion: 2.1 time: 0.157314 Oct 28 08:40:45.965845 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 91/181] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:45 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:46.088156 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-f1fae68b-1b36-4af3-a442-0f3d0e5b2722 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:46.096192 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f1fae68b-1b36-4af3-a442-0f3d0e5b2722 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.150742 Oct 28 08:40:46.096765 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 91/182] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:45 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:46.230135 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6b827406-0d2f-4acc-a743-ec3156d04e1f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:46.230711 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6b827406-0d2f-4acc-a743-ec3156d04e1f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:46.237087 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b827406-0d2f-4acc-a743-ec3156d04e1f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:46.237519 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b827406-0d2f-4acc-a743-ec3156d04e1f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:46.238260 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b827406-0d2f-4acc-a743-ec3156d04e1f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:46.238703 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b827406-0d2f-4acc-a743-ec3156d04e1f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:46.361902 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-6b827406-0d2f-4acc-a743-ec3156d04e1f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:46.369575 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-6b827406-0d2f-4acc-a743-ec3156d04e1f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:46.371089 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-6b827406-0d2f-4acc-a743-ec3156d04e1f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:46.372167 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6b827406-0d2f-4acc-a743-ec3156d04e1f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1406 microversion: 2.20 time: 0.145982 Oct 28 08:40:46.372721 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 92/183] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:46 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1406 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:40:46.528510 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b7beebf4-db20-45f0-bfe5-03aab17c0722 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:46.529017 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b7beebf4-db20-45f0-bfe5-03aab17c0722 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:46.536012 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7beebf4-db20-45f0-bfe5-03aab17c0722 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:46.536441 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7beebf4-db20-45f0-bfe5-03aab17c0722 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:46.537181 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7beebf4-db20-45f0-bfe5-03aab17c0722 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:46.537597 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7beebf4-db20-45f0-bfe5-03aab17c0722 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:46.658847 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-b7beebf4-db20-45f0-bfe5-03aab17c0722 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:46.665964 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b7beebf4-db20-45f0-bfe5-03aab17c0722 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.141171 Oct 28 08:40:46.666793 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 92/184] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:46 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:46.775183 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-823bedc3-c55b-49ff-b287-9ba7d1723c4b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:46.775782 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-823bedc3-c55b-49ff-b287-9ba7d1723c4b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:46.784163 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-823bedc3-c55b-49ff-b287-9ba7d1723c4b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:46.784531 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-823bedc3-c55b-49ff-b287-9ba7d1723c4b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:46.785285 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-823bedc3-c55b-49ff-b287-9ba7d1723c4b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:46.785708 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-823bedc3-c55b-49ff-b287-9ba7d1723c4b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:46.910018 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-823bedc3-c55b-49ff-b287-9ba7d1723c4b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:46.917235 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-823bedc3-c55b-49ff-b287-9ba7d1723c4b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.147185 Oct 28 08:40:46.917791 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 93/185] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:46 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:46.981769 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b77a8ba5-1657-45b8-8499-6fd07bd66558 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:46.982366 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b77a8ba5-1657-45b8-8499-6fd07bd66558 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:46.988499 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b77a8ba5-1657-45b8-8499-6fd07bd66558 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:46.988941 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b77a8ba5-1657-45b8-8499-6fd07bd66558 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:46.989694 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b77a8ba5-1657-45b8-8499-6fd07bd66558 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:46.990123 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b77a8ba5-1657-45b8-8499-6fd07bd66558 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:47.114869 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4e3d35af-59fd-4480-a961-bd54dd3db02a tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:47.115301 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4e3d35af-59fd-4480-a961-bd54dd3db02a tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:47.117033 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-b77a8ba5-1657-45b8-8499-6fd07bd66558 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:47.121214 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e3d35af-59fd-4480-a961-bd54dd3db02a tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:47.121646 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e3d35af-59fd-4480-a961-bd54dd3db02a tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:47.122399 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e3d35af-59fd-4480-a961-bd54dd3db02a tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:47.122844 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e3d35af-59fd-4480-a961-bd54dd3db02a tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:47.124272 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b77a8ba5-1657-45b8-8499-6fd07bd66558 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1363 microversion: 2.1 time: 0.146224 Oct 28 08:40:47.125625 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 93/186] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:46 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:47.244477 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-4e3d35af-59fd-4480-a961-bd54dd3db02a tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:47.251904 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4e3d35af-59fd-4480-a961-bd54dd3db02a tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.140707 Oct 28 08:40:47.252382 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 94/187] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:47 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:47.389996 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-79da8309-efee-4ad7-941f-9029cd12b324 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:47.391259 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-79da8309-efee-4ad7-941f-9029cd12b324 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:47.397063 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79da8309-efee-4ad7-941f-9029cd12b324 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:47.397498 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79da8309-efee-4ad7-941f-9029cd12b324 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:47.398249 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79da8309-efee-4ad7-941f-9029cd12b324 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:47.398703 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79da8309-efee-4ad7-941f-9029cd12b324 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:47.521943 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-79da8309-efee-4ad7-941f-9029cd12b324 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:47.529776 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-79da8309-efee-4ad7-941f-9029cd12b324 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:47.531315 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-79da8309-efee-4ad7-941f-9029cd12b324 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:47.532586 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-79da8309-efee-4ad7-941f-9029cd12b324 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1406 microversion: 2.20 time: 0.146235 Oct 28 08:40:47.533146 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 94/188] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:47 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1406 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:40:47.683344 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f67a2a73-1b3f-4ff3-a7a4-8c13d551d2e1 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:47.683852 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f67a2a73-1b3f-4ff3-a7a4-8c13d551d2e1 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:47.692005 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f67a2a73-1b3f-4ff3-a7a4-8c13d551d2e1 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:47.692440 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f67a2a73-1b3f-4ff3-a7a4-8c13d551d2e1 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:47.693196 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f67a2a73-1b3f-4ff3-a7a4-8c13d551d2e1 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:47.693613 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f67a2a73-1b3f-4ff3-a7a4-8c13d551d2e1 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:47.817273 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-f67a2a73-1b3f-4ff3-a7a4-8c13d551d2e1 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:47.824373 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f67a2a73-1b3f-4ff3-a7a4-8c13d551d2e1 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.144775 Oct 28 08:40:47.824928 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 95/189] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:47 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:47.935127 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-30df94a4-c225-4d06-adb6-64952b9e8404 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:47.935630 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-30df94a4-c225-4d06-adb6-64952b9e8404 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:47.942968 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30df94a4-c225-4d06-adb6-64952b9e8404 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:47.943401 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30df94a4-c225-4d06-adb6-64952b9e8404 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:47.944154 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30df94a4-c225-4d06-adb6-64952b9e8404 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:47.944578 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30df94a4-c225-4d06-adb6-64952b9e8404 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:48.067661 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-30df94a4-c225-4d06-adb6-64952b9e8404 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:48.074891 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-30df94a4-c225-4d06-adb6-64952b9e8404 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.143437 Oct 28 08:40:48.075458 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 95/190] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:47 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:48.141551 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5bac1a41-4904-4c66-94c5-a88bd3f07f3b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:48.142148 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5bac1a41-4904-4c66-94c5-a88bd3f07f3b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:48.148139 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bac1a41-4904-4c66-94c5-a88bd3f07f3b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:48.148673 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bac1a41-4904-4c66-94c5-a88bd3f07f3b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:48.149418 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bac1a41-4904-4c66-94c5-a88bd3f07f3b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:48.149833 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bac1a41-4904-4c66-94c5-a88bd3f07f3b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:48.269684 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8eecb9d2-7101-4215-bd9d-72e78a1c7b7e tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:48.270335 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8eecb9d2-7101-4215-bd9d-72e78a1c7b7e tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:48.272177 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-5bac1a41-4904-4c66-94c5-a88bd3f07f3b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:48.276200 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8eecb9d2-7101-4215-bd9d-72e78a1c7b7e tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:48.276633 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8eecb9d2-7101-4215-bd9d-72e78a1c7b7e tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:48.277392 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8eecb9d2-7101-4215-bd9d-72e78a1c7b7e tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:48.277814 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8eecb9d2-7101-4215-bd9d-72e78a1c7b7e tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:48.279689 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5bac1a41-4904-4c66-94c5-a88bd3f07f3b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1363 microversion: 2.1 time: 0.142361 Oct 28 08:40:48.280281 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 96/191] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:48 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1363 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:48.402332 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-8eecb9d2-7101-4215-bd9d-72e78a1c7b7e tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:48.409746 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8eecb9d2-7101-4215-bd9d-72e78a1c7b7e tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.144808 Oct 28 08:40:48.410310 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 96/192] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:48 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:48.550844 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-207ff49f-f826-484f-9b02-6eb076739762 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:48.551459 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-207ff49f-f826-484f-9b02-6eb076739762 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:48.557313 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-207ff49f-f826-484f-9b02-6eb076739762 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:48.557755 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-207ff49f-f826-484f-9b02-6eb076739762 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:48.558569 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-207ff49f-f826-484f-9b02-6eb076739762 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:48.559000 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-207ff49f-f826-484f-9b02-6eb076739762 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:48.677295 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-207ff49f-f826-484f-9b02-6eb076739762 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:48.688720 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-207ff49f-f826-484f-9b02-6eb076739762 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:48.690239 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-207ff49f-f826-484f-9b02-6eb076739762 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:48.691382 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-207ff49f-f826-484f-9b02-6eb076739762 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1406 microversion: 2.20 time: 0.144971 Oct 28 08:40:48.691945 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 97/193] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:48 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1406 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:40:48.841628 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-542cfd91-99ee-4c3f-acaf-8c174f44dcc6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:48.842231 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-542cfd91-99ee-4c3f-acaf-8c174f44dcc6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:48.849099 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-542cfd91-99ee-4c3f-acaf-8c174f44dcc6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:48.849545 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-542cfd91-99ee-4c3f-acaf-8c174f44dcc6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:48.850595 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-542cfd91-99ee-4c3f-acaf-8c174f44dcc6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:48.851070 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-542cfd91-99ee-4c3f-acaf-8c174f44dcc6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:49.004628 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-542cfd91-99ee-4c3f-acaf-8c174f44dcc6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:49.012103 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-542cfd91-99ee-4c3f-acaf-8c174f44dcc6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.174162 Oct 28 08:40:49.013174 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 97/194] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:48 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:49.095852 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5cd98158-a432-48e9-bc53-2b8c2cfe6b2e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:49.096407 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5cd98158-a432-48e9-bc53-2b8c2cfe6b2e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:49.110771 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cd98158-a432-48e9-bc53-2b8c2cfe6b2e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:49.111522 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cd98158-a432-48e9-bc53-2b8c2cfe6b2e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:49.112625 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cd98158-a432-48e9-bc53-2b8c2cfe6b2e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:49.113633 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cd98158-a432-48e9-bc53-2b8c2cfe6b2e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:49.240738 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-5cd98158-a432-48e9-bc53-2b8c2cfe6b2e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:49.248971 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5cd98158-a432-48e9-bc53-2b8c2cfe6b2e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.160335 Oct 28 08:40:49.249583 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 98/195] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:49 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:49.295913 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2c4ce983-3a1b-461a-9203-c0390423a5b8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:49.297270 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2c4ce983-3a1b-461a-9203-c0390423a5b8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:49.303879 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c4ce983-3a1b-461a-9203-c0390423a5b8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:49.304311 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c4ce983-3a1b-461a-9203-c0390423a5b8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:49.305085 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c4ce983-3a1b-461a-9203-c0390423a5b8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:49.305924 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c4ce983-3a1b-461a-9203-c0390423a5b8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:49.427938 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7f8c4116-8cff-48c7-9c9c-b812ae2a9b36 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:49.428673 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7f8c4116-8cff-48c7-9c9c-b812ae2a9b36 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:49.435945 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f8c4116-8cff-48c7-9c9c-b812ae2a9b36 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:49.436517 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f8c4116-8cff-48c7-9c9c-b812ae2a9b36 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:49.437743 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f8c4116-8cff-48c7-9c9c-b812ae2a9b36 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:49.438187 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f8c4116-8cff-48c7-9c9c-b812ae2a9b36 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:49.443192 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-2c4ce983-3a1b-461a-9203-c0390423a5b8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:49.450417 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2c4ce983-3a1b-461a-9203-c0390423a5b8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1363 microversion: 2.1 time: 0.158054 Oct 28 08:40:49.454531 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 98/196] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:49 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:49.575523 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-7f8c4116-8cff-48c7-9c9c-b812ae2a9b36 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:49.585451 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7f8c4116-8cff-48c7-9c9c-b812ae2a9b36 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.162031 Oct 28 08:40:49.586391 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 99/197] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:49 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:49.709997 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eb977976-067a-43b6-b329-4d971bf36592 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:49.710833 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-eb977976-067a-43b6-b329-4d971bf36592 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:49.716856 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb977976-067a-43b6-b329-4d971bf36592 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:49.717342 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb977976-067a-43b6-b329-4d971bf36592 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:49.718165 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb977976-067a-43b6-b329-4d971bf36592 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:49.718633 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb977976-067a-43b6-b329-4d971bf36592 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:49.857905 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-eb977976-067a-43b6-b329-4d971bf36592 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:49.875604 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-eb977976-067a-43b6-b329-4d971bf36592 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:49.877944 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-eb977976-067a-43b6-b329-4d971bf36592 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:49.879155 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eb977976-067a-43b6-b329-4d971bf36592 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1406 microversion: 2.20 time: 0.173103 Oct 28 08:40:49.879792 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 99/198] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:49 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:40:50.029087 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0100446d-644c-4f60-8e20-d0879266d938 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:50.029589 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0100446d-644c-4f60-8e20-d0879266d938 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:50.036726 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0100446d-644c-4f60-8e20-d0879266d938 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:50.037170 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0100446d-644c-4f60-8e20-d0879266d938 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:50.037943 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0100446d-644c-4f60-8e20-d0879266d938 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:50.038363 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0100446d-644c-4f60-8e20-d0879266d938 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:50.178210 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-0100446d-644c-4f60-8e20-d0879266d938 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:50.186139 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0100446d-644c-4f60-8e20-d0879266d938 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.160691 Oct 28 08:40:50.186777 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 100/199] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:50 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:50.275365 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f93471ec-adf1-49e2-94f9-35cf007c95be tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:50.276631 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f93471ec-adf1-49e2-94f9-35cf007c95be tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:50.283819 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f93471ec-adf1-49e2-94f9-35cf007c95be tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:50.284134 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f93471ec-adf1-49e2-94f9-35cf007c95be tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:50.284972 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f93471ec-adf1-49e2-94f9-35cf007c95be tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:50.285403 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f93471ec-adf1-49e2-94f9-35cf007c95be tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:50.437672 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-f93471ec-adf1-49e2-94f9-35cf007c95be tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:50.445593 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f93471ec-adf1-49e2-94f9-35cf007c95be tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.181937 Oct 28 08:40:50.446171 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 100/200] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:50 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:50.468745 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-24be7194-28a6-4fa3-b68a-e5e5aa792729 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:50.469636 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-24be7194-28a6-4fa3-b68a-e5e5aa792729 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:50.475789 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24be7194-28a6-4fa3-b68a-e5e5aa792729 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:50.476375 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24be7194-28a6-4fa3-b68a-e5e5aa792729 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:50.477361 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24be7194-28a6-4fa3-b68a-e5e5aa792729 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:50.477784 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24be7194-28a6-4fa3-b68a-e5e5aa792729 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:50.602809 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-24be7194-28a6-4fa3-b68a-e5e5aa792729 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:50.603803 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-299e6c13-fbf8-4028-bb3a-083331edaf95 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:50.604630 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-299e6c13-fbf8-4028-bb3a-083331edaf95 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:50.610524 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-24be7194-28a6-4fa3-b68a-e5e5aa792729 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1363 microversion: 2.1 time: 0.145517 Oct 28 08:40:50.610706 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-299e6c13-fbf8-4028-bb3a-083331edaf95 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:50.611360 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-299e6c13-fbf8-4028-bb3a-083331edaf95 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:50.611481 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 101/201] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:50 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:50.612129 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-299e6c13-fbf8-4028-bb3a-083331edaf95 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:50.612614 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-299e6c13-fbf8-4028-bb3a-083331edaf95 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:50.735481 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-299e6c13-fbf8-4028-bb3a-083331edaf95 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:50.742785 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-299e6c13-fbf8-4028-bb3a-083331edaf95 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.143219 Oct 28 08:40:50.743343 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 101/202] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:50 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:50.898083 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9905225f-5f92-4783-aee6-f97376e0efdf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:50.898974 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9905225f-5f92-4783-aee6-f97376e0efdf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:50.905671 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9905225f-5f92-4783-aee6-f97376e0efdf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:50.906460 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9905225f-5f92-4783-aee6-f97376e0efdf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:50.907760 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9905225f-5f92-4783-aee6-f97376e0efdf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:50.908328 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9905225f-5f92-4783-aee6-f97376e0efdf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:51.038650 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-9905225f-5f92-4783-aee6-f97376e0efdf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:51.047584 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-9905225f-5f92-4783-aee6-f97376e0efdf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:51.049238 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-9905225f-5f92-4783-aee6-f97376e0efdf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:51.050320 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9905225f-5f92-4783-aee6-f97376e0efdf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1406 microversion: 2.20 time: 0.156703 Oct 28 08:40:51.050897 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 102/203] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:50 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:40:51.203206 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-84535a56-693d-495f-98f1-3596cf4b6391 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:51.203718 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-84535a56-693d-495f-98f1-3596cf4b6391 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:51.209840 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84535a56-693d-495f-98f1-3596cf4b6391 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:51.210283 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84535a56-693d-495f-98f1-3596cf4b6391 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:51.211076 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84535a56-693d-495f-98f1-3596cf4b6391 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:51.211509 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84535a56-693d-495f-98f1-3596cf4b6391 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:51.331874 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-84535a56-693d-495f-98f1-3596cf4b6391 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:51.339027 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-84535a56-693d-495f-98f1-3596cf4b6391 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.139522 Oct 28 08:40:51.339586 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 102/204] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:51 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:51.463429 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-13ca28f9-41f4-4636-be09-86c65d2e2d1c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:51.464002 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-13ca28f9-41f4-4636-be09-86c65d2e2d1c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:51.471223 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13ca28f9-41f4-4636-be09-86c65d2e2d1c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:51.471774 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13ca28f9-41f4-4636-be09-86c65d2e2d1c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:51.472542 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13ca28f9-41f4-4636-be09-86c65d2e2d1c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:51.472955 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13ca28f9-41f4-4636-be09-86c65d2e2d1c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:51.614648 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-13ca28f9-41f4-4636-be09-86c65d2e2d1c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:51.626229 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-13ca28f9-41f4-4636-be09-86c65d2e2d1c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.166324 Oct 28 08:40:51.627188 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 103/205] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:51 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:51.633394 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e9fb880c-bc69-4b5c-8153-9ff577975ff9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:51.634510 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e9fb880c-bc69-4b5c-8153-9ff577975ff9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:51.641985 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9fb880c-bc69-4b5c-8153-9ff577975ff9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:51.642711 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9fb880c-bc69-4b5c-8153-9ff577975ff9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:51.643826 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9fb880c-bc69-4b5c-8153-9ff577975ff9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:51.644346 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9fb880c-bc69-4b5c-8153-9ff577975ff9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:51.764966 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e6d41cac-15db-4291-b89b-87dab1454a4b tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:51.766852 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e6d41cac-15db-4291-b89b-87dab1454a4b tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:51.774469 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6d41cac-15db-4291-b89b-87dab1454a4b tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:51.775184 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6d41cac-15db-4291-b89b-87dab1454a4b tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:51.776295 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6d41cac-15db-4291-b89b-87dab1454a4b tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:51.776855 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6d41cac-15db-4291-b89b-87dab1454a4b tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:51.788067 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-e9fb880c-bc69-4b5c-8153-9ff577975ff9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:51.796176 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e9fb880c-bc69-4b5c-8153-9ff577975ff9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1363 microversion: 2.1 time: 0.171880 Oct 28 08:40:51.797157 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 103/206] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:51 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:51.982151 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-e6d41cac-15db-4291-b89b-87dab1454a4b tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:51.991607 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e6d41cac-15db-4291-b89b-87dab1454a4b tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.232601 Oct 28 08:40:51.992379 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 104/207] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:51 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:52.069266 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cf1e26de-ad51-4c88-b6bf-4ae3a22b962f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:52.069949 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cf1e26de-ad51-4c88-b6bf-4ae3a22b962f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:52.078370 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf1e26de-ad51-4c88-b6bf-4ae3a22b962f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:52.078746 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf1e26de-ad51-4c88-b6bf-4ae3a22b962f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:52.080326 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf1e26de-ad51-4c88-b6bf-4ae3a22b962f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:52.080761 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf1e26de-ad51-4c88-b6bf-4ae3a22b962f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:52.301198 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-cf1e26de-ad51-4c88-b6bf-4ae3a22b962f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:52.311809 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-cf1e26de-ad51-4c88-b6bf-4ae3a22b962f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:52.314293 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-cf1e26de-ad51-4c88-b6bf-4ae3a22b962f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:52.319072 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cf1e26de-ad51-4c88-b6bf-4ae3a22b962f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1406 microversion: 2.20 time: 0.254513 Oct 28 08:40:52.332505 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 104/208] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:52 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:40:52.356574 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c83642ad-9928-4490-b72e-187a7d30ed00 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:52.357255 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c83642ad-9928-4490-b72e-187a7d30ed00 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:52.370370 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c83642ad-9928-4490-b72e-187a7d30ed00 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:52.371563 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c83642ad-9928-4490-b72e-187a7d30ed00 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:52.372547 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c83642ad-9928-4490-b72e-187a7d30ed00 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:52.373091 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c83642ad-9928-4490-b72e-187a7d30ed00 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:52.375283 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-8e6b815c-e62e-4f87-b6e1-adbe17a044f1 req-00474aeb-bff3-47be-9a67-7b0ff352a522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fecc28dc-ead2-481a-a3a5-7b5702510113", "name": "network-vif-plugged", "status": "completed", "tag": "e8d31af7-741e-4880-988e-5bfcf3a45f01"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:52.379322 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:40:52.379322 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:40:52.399968 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8e6b815c-e62e-4f87-b6e1-adbe17a044f1 req-00474aeb-bff3-47be-9a67-7b0ff352a522 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:52.402078 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8e6b815c-e62e-4f87-b6e1-adbe17a044f1 req-00474aeb-bff3-47be-9a67-7b0ff352a522 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:52.442100 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-8e6b815c-e62e-4f87-b6e1-adbe17a044f1 req-00474aeb-bff3-47be-9a67-7b0ff352a522 service nova] Creating event network-vif-plugged:e8d31af7-741e-4880-988e-5bfcf3a45f01 for instance fecc28dc-ead2-481a-a3a5-7b5702510113 on hv-cinder-81565 Oct 28 08:40:52.455888 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-8e6b815c-e62e-4f87-b6e1-adbe17a044f1 req-00474aeb-bff3-47be-9a67-7b0ff352a522 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085268 Oct 28 08:40:52.460327 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 105/209] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:40:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:52.583536 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-c83642ad-9928-4490-b72e-187a7d30ed00 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:52.600864 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c83642ad-9928-4490-b72e-187a7d30ed00 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.247937 Oct 28 08:40:52.603978 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 105/210] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:52 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:52.644803 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-efd5aa47-f6f9-439d-baf6-333c5e5afb25 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:52.646067 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-efd5aa47-f6f9-439d-baf6-333c5e5afb25 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:52.654983 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efd5aa47-f6f9-439d-baf6-333c5e5afb25 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:52.657001 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efd5aa47-f6f9-439d-baf6-333c5e5afb25 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:52.658209 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efd5aa47-f6f9-439d-baf6-333c5e5afb25 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:52.658888 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efd5aa47-f6f9-439d-baf6-333c5e5afb25 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:52.813943 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1e1d63a1-5bbb-4a08-a5e1-b874a17e1285 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:52.821720 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1e1d63a1-5bbb-4a08-a5e1-b874a17e1285 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:52.834692 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e1d63a1-5bbb-4a08-a5e1-b874a17e1285 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:52.835142 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e1d63a1-5bbb-4a08-a5e1-b874a17e1285 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:52.835951 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e1d63a1-5bbb-4a08-a5e1-b874a17e1285 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:52.836387 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e1d63a1-5bbb-4a08-a5e1-b874a17e1285 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:52.863895 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-efd5aa47-f6f9-439d-baf6-333c5e5afb25 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:52.877811 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-efd5aa47-f6f9-439d-baf6-333c5e5afb25 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.235452 Oct 28 08:40:52.878819 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 106/211] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:52 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:53.011915 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c1e4174d-18c2-4cf2-8ae1-9f093d34948d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:53.013058 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c1e4174d-18c2-4cf2-8ae1-9f093d34948d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:53.021675 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1e4174d-18c2-4cf2-8ae1-9f093d34948d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:53.022471 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1e4174d-18c2-4cf2-8ae1-9f093d34948d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:53.023735 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1e4174d-18c2-4cf2-8ae1-9f093d34948d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:53.024369 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1e4174d-18c2-4cf2-8ae1-9f093d34948d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:53.122634 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1e1d63a1-5bbb-4a08-a5e1-b874a17e1285 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:53.135316 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1e1d63a1-5bbb-4a08-a5e1-b874a17e1285 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1363 microversion: 2.1 time: 0.320776 Oct 28 08:40:53.136329 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 106/212] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:52 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1363 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:53.269050 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c1e4174d-18c2-4cf2-8ae1-9f093d34948d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:53.276859 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c1e4174d-18c2-4cf2-8ae1-9f093d34948d tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.269322 Oct 28 08:40:53.277521 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 107/213] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:53 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:53.339412 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f906743b-bc16-486f-805c-7f2f80dd0692 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:53.340138 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f906743b-bc16-486f-805c-7f2f80dd0692 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:53.347131 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f906743b-bc16-486f-805c-7f2f80dd0692 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:53.347874 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f906743b-bc16-486f-805c-7f2f80dd0692 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:53.348837 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f906743b-bc16-486f-805c-7f2f80dd0692 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:53.349862 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f906743b-bc16-486f-805c-7f2f80dd0692 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:53.505199 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-f906743b-bc16-486f-805c-7f2f80dd0692 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:53.513611 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-f906743b-bc16-486f-805c-7f2f80dd0692 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:53.519651 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-f906743b-bc16-486f-805c-7f2f80dd0692 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:53.523786 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f906743b-bc16-486f-805c-7f2f80dd0692 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1406 microversion: 2.20 time: 0.188236 Oct 28 08:40:53.526781 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 107/214] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:53 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:40:53.620015 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e71ff4ba-39a6-41a5-b7e2-01c573d36ec7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:53.620806 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e71ff4ba-39a6-41a5-b7e2-01c573d36ec7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:53.631036 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e71ff4ba-39a6-41a5-b7e2-01c573d36ec7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:53.631430 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e71ff4ba-39a6-41a5-b7e2-01c573d36ec7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:53.632219 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e71ff4ba-39a6-41a5-b7e2-01c573d36ec7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:53.632648 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e71ff4ba-39a6-41a5-b7e2-01c573d36ec7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:53.838372 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-e71ff4ba-39a6-41a5-b7e2-01c573d36ec7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:53.848541 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e71ff4ba-39a6-41a5-b7e2-01c573d36ec7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1322 microversion: 2.1 time: 0.232440 Oct 28 08:40:53.852157 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 108/215] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:53 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:53.897324 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a5bb7437-d045-4411-a684-9bed05c88d23 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:53.897926 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a5bb7437-d045-4411-a684-9bed05c88d23 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:53.920407 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5bb7437-d045-4411-a684-9bed05c88d23 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:53.920912 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5bb7437-d045-4411-a684-9bed05c88d23 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:53.921788 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5bb7437-d045-4411-a684-9bed05c88d23 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:53.922224 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5bb7437-d045-4411-a684-9bed05c88d23 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:54.082585 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-a5bb7437-d045-4411-a684-9bed05c88d23 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:54.104264 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a5bb7437-d045-4411-a684-9bed05c88d23 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.204242 Oct 28 08:40:54.107603 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 108/216] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:53 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:54.152630 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fbc7af5a-47be-4404-b1b4-449b0daadb22 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:54.153233 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fbc7af5a-47be-4404-b1b4-449b0daadb22 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:54.160473 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbc7af5a-47be-4404-b1b4-449b0daadb22 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:54.160913 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbc7af5a-47be-4404-b1b4-449b0daadb22 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:54.161892 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbc7af5a-47be-4404-b1b4-449b0daadb22 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:54.163007 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbc7af5a-47be-4404-b1b4-449b0daadb22 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:54.300023 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4be87160-1782-413f-8f60-78901ab98d13 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:54.301690 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4be87160-1782-413f-8f60-78901ab98d13 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:54.316787 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4be87160-1782-413f-8f60-78901ab98d13 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:54.317240 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4be87160-1782-413f-8f60-78901ab98d13 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:54.318019 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4be87160-1782-413f-8f60-78901ab98d13 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:54.318449 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4be87160-1782-413f-8f60-78901ab98d13 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:54.333842 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-fbc7af5a-47be-4404-b1b4-449b0daadb22 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:54.343008 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fbc7af5a-47be-4404-b1b4-449b0daadb22 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1363 microversion: 2.1 time: 0.194077 Oct 28 08:40:54.354920 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 109/217] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:54 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:54.479925 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-9fe52f46-b1e7-40d8-9474-78aefcfb42ee req-56b82992-d463-4736-9312-b1d70fc65550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e3ca69d-4e09-4205-b6ec-2a6189724e46", "name": "network-vif-plugged", "status": "completed", "tag": "b51a5869-7eac-401f-ad13-59a689851a50"}, {"server_uuid": "914cd123-e872-418a-bf38-f477fe1551b3", "name": "network-vif-plugged", "status": "completed", "tag": "bc82b34a-5083-4fe6-8ca3-57d3482a7509"}, {"server_uuid": "3127fb3d-04bf-4ef2-b534-cd6fd65f614f", "name": "network-vif-plugged", "status": "completed", "tag": "64609431-9691-46a8-a89b-e479eb357768"}, {"server_uuid": "2ef6e834-e02d-41aa-8962-4caf135b9d54", "name": "network-vif-plugged", "status": "completed", "tag": "9ea8a9e5-c360-4361-8ee7-43bd5674b3d6"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:54.483303 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:40:54.483303 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:40:54.510347 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9fe52f46-b1e7-40d8-9474-78aefcfb42ee req-56b82992-d463-4736-9312-b1d70fc65550 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:54.510826 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9fe52f46-b1e7-40d8-9474-78aefcfb42ee req-56b82992-d463-4736-9312-b1d70fc65550 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:54.520627 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-4be87160-1782-413f-8f60-78901ab98d13 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:54.531609 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4be87160-1782-413f-8f60-78901ab98d13 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.237675 Oct 28 08:40:54.532636 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 109/218] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:54 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:54.534146 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-9fe52f46-b1e7-40d8-9474-78aefcfb42ee req-56b82992-d463-4736-9312-b1d70fc65550 service nova] Creating event network-vif-plugged:b51a5869-7eac-401f-ad13-59a689851a50 for instance 4e3ca69d-4e09-4205-b6ec-2a6189724e46 on hv-cinder-81565 Oct 28 08:40:54.535647 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-9fe52f46-b1e7-40d8-9474-78aefcfb42ee req-56b82992-d463-4736-9312-b1d70fc65550 service nova] Creating event network-vif-plugged:bc82b34a-5083-4fe6-8ca3-57d3482a7509 for instance 914cd123-e872-418a-bf38-f477fe1551b3 on hv-cinder-81565 Oct 28 08:40:54.537905 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-9fe52f46-b1e7-40d8-9474-78aefcfb42ee req-56b82992-d463-4736-9312-b1d70fc65550 service nova] Creating event network-vif-plugged:64609431-9691-46a8-a89b-e479eb357768 for instance 3127fb3d-04bf-4ef2-b534-cd6fd65f614f on hv-cinder-81565 Oct 28 08:40:54.538977 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-9fe52f46-b1e7-40d8-9474-78aefcfb42ee req-56b82992-d463-4736-9312-b1d70fc65550 service nova] Creating event network-vif-plugged:9ea8a9e5-c360-4361-8ee7-43bd5674b3d6 for instance 2ef6e834-e02d-41aa-8962-4caf135b9d54 on hv-cinder-81565 Oct 28 08:40:54.550282 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-9fe52f46-b1e7-40d8-9474-78aefcfb42ee req-56b82992-d463-4736-9312-b1d70fc65550 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.074266 Oct 28 08:40:54.551710 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 110/219] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:40:54 2021] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:40:54.556862 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-97430e9a-19ea-4123-aaec-1acc55422d5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:54.557815 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-97430e9a-19ea-4123-aaec-1acc55422d5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:54.570527 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97430e9a-19ea-4123-aaec-1acc55422d5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:54.570976 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97430e9a-19ea-4123-aaec-1acc55422d5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:54.571770 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97430e9a-19ea-4123-aaec-1acc55422d5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:54.572191 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97430e9a-19ea-4123-aaec-1acc55422d5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:54.737325 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-97430e9a-19ea-4123-aaec-1acc55422d5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:54.747886 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-97430e9a-19ea-4123-aaec-1acc55422d5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:54.750408 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-97430e9a-19ea-4123-aaec-1acc55422d5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:54.751637 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-97430e9a-19ea-4123-aaec-1acc55422d5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1406 microversion: 2.20 time: 0.207938 Oct 28 08:40:54.753325 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 110/220] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:54 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:40:54.866643 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-300ac383-60ea-42b3-a9fa-d245ef4eb3c9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:54.868884 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-300ac383-60ea-42b3-a9fa-d245ef4eb3c9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:54.879699 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-300ac383-60ea-42b3-a9fa-d245ef4eb3c9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:54.880328 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-300ac383-60ea-42b3-a9fa-d245ef4eb3c9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:54.881490 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-300ac383-60ea-42b3-a9fa-d245ef4eb3c9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:54.882067 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-300ac383-60ea-42b3-a9fa-d245ef4eb3c9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:55.131618 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ad856706-d223-487c-968e-2fca249dbb10 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:55.133735 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ad856706-d223-487c-968e-2fca249dbb10 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:55.144207 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad856706-d223-487c-968e-2fca249dbb10 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:55.145028 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad856706-d223-487c-968e-2fca249dbb10 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:55.146641 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad856706-d223-487c-968e-2fca249dbb10 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:55.147400 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad856706-d223-487c-968e-2fca249dbb10 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:55.150156 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-300ac383-60ea-42b3-a9fa-d245ef4eb3c9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:55.159444 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-300ac383-60ea-42b3-a9fa-d245ef4eb3c9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1515 microversion: 2.1 time: 0.297291 Oct 28 08:40:55.159886 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 111/221] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:54 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1515 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:55.180665 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4a828e9e-17eb-44f2-9275-a2367b8fe901 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:40:55.181622 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4a828e9e-17eb-44f2-9275-a2367b8fe901 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:55.198589 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a828e9e-17eb-44f2-9275-a2367b8fe901 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:55.199364 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a828e9e-17eb-44f2-9275-a2367b8fe901 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:55.200396 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a828e9e-17eb-44f2-9275-a2367b8fe901 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:55.201013 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a828e9e-17eb-44f2-9275-a2367b8fe901 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:55.316917 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-4a828e9e-17eb-44f2-9275-a2367b8fe901 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lazy-loading 'flavor' on Instance uuid fecc28dc-ead2-481a-a3a5-7b5702510113 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:40:55.471297 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-ad856706-d223-487c-968e-2fca249dbb10 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:55.477767 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4a828e9e-17eb-44f2-9275-a2367b8fe901 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "POST /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113/action" status: 200 len: 32 microversion: 2.1 time: 0.301355 Oct 28 08:40:55.479204 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 112/222] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:40:55 2021] POST /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113/action => generated 32 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:40:55.481521 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ad856706-d223-487c-968e-2fca249dbb10 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.361649 Oct 28 08:40:55.484226 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6581a25d-c360-440c-89e2-b0760dc87a6a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:55.484923 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6581a25d-c360-440c-89e2-b0760dc87a6a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:55.490879 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6581a25d-c360-440c-89e2-b0760dc87a6a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:55.491295 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6581a25d-c360-440c-89e2-b0760dc87a6a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:55.492057 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6581a25d-c360-440c-89e2-b0760dc87a6a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:55.492483 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6581a25d-c360-440c-89e2-b0760dc87a6a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:55.494319 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 111/223] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:55 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:55.505539 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f34e4c8b-4b46-428a-b34a-035d1949f341 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:55.506223 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f34e4c8b-4b46-428a-b34a-035d1949f341 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:55.515739 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f34e4c8b-4b46-428a-b34a-035d1949f341 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:55.516543 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f34e4c8b-4b46-428a-b34a-035d1949f341 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:55.517983 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f34e4c8b-4b46-428a-b34a-035d1949f341 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:55.518990 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f34e4c8b-4b46-428a-b34a-035d1949f341 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:55.690755 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-6581a25d-c360-440c-89e2-b0760dc87a6a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:55.699719 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6581a25d-c360-440c-89e2-b0760dc87a6a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1363 microversion: 2.1 time: 0.219302 Oct 28 08:40:55.700991 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 113/224] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:55 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:55.715520 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5562c41e-f980-4a53-8b5f-d4a61ff43c81 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:55.716411 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5562c41e-f980-4a53-8b5f-d4a61ff43c81 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:55.723682 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5562c41e-f980-4a53-8b5f-d4a61ff43c81 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:55.724717 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5562c41e-f980-4a53-8b5f-d4a61ff43c81 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:55.725748 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5562c41e-f980-4a53-8b5f-d4a61ff43c81 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:55.726386 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5562c41e-f980-4a53-8b5f-d4a61ff43c81 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:55.731402 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-f34e4c8b-4b46-428a-b34a-035d1949f341 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:55.741136 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f34e4c8b-4b46-428a-b34a-035d1949f341 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.245650 Oct 28 08:40:55.741805 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 112/225] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:55 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:55.769939 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bc4e8c4f-3ed7-4b1e-a5c2-313caf4ca088 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:55.770573 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bc4e8c4f-3ed7-4b1e-a5c2-313caf4ca088 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:55.776961 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc4e8c4f-3ed7-4b1e-a5c2-313caf4ca088 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:55.777409 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc4e8c4f-3ed7-4b1e-a5c2-313caf4ca088 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:55.778180 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc4e8c4f-3ed7-4b1e-a5c2-313caf4ca088 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:55.778646 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc4e8c4f-3ed7-4b1e-a5c2-313caf4ca088 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:55.926586 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-5562c41e-f980-4a53-8b5f-d4a61ff43c81 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:55.935500 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5562c41e-f980-4a53-8b5f-d4a61ff43c81 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.223454 Oct 28 08:40:55.936110 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 114/226] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:55 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:55.964973 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-bc4e8c4f-3ed7-4b1e-a5c2-313caf4ca088 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:55.978757 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-bc4e8c4f-3ed7-4b1e-a5c2-313caf4ca088 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:55.980261 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-bc4e8c4f-3ed7-4b1e-a5c2-313caf4ca088 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:55.981364 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bc4e8c4f-3ed7-4b1e-a5c2-313caf4ca088 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1406 microversion: 2.20 time: 0.215199 Oct 28 08:40:55.981915 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 113/227] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:55 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:40:56.499926 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e9aae94a-3eea-4d7f-8ea7-ec0d3a93720a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:56.501425 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e9aae94a-3eea-4d7f-8ea7-ec0d3a93720a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:56.507568 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9aae94a-3eea-4d7f-8ea7-ec0d3a93720a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:56.508000 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9aae94a-3eea-4d7f-8ea7-ec0d3a93720a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:56.508789 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9aae94a-3eea-4d7f-8ea7-ec0d3a93720a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:56.509205 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9aae94a-3eea-4d7f-8ea7-ec0d3a93720a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:56.717514 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7d06ba29-9473-4cfb-9d86-01c5f0f49a59 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:56.718492 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7d06ba29-9473-4cfb-9d86-01c5f0f49a59 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:56.726252 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7d06ba29-9473-4cfb-9d86-01c5f0f49a59 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:56.728905 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7d06ba29-9473-4cfb-9d86-01c5f0f49a59 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:56.728905 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7d06ba29-9473-4cfb-9d86-01c5f0f49a59 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:56.728905 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7d06ba29-9473-4cfb-9d86-01c5f0f49a59 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:57.125761 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-e9aae94a-3eea-4d7f-8ea7-ec0d3a93720a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:57.135510 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e9aae94a-3eea-4d7f-8ea7-ec0d3a93720a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1318 microversion: 2.1 time: 0.640082 Oct 28 08:40:57.136862 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-7d06ba29-9473-4cfb-9d86-01c5f0f49a59 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:57.137125 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 115/228] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:56 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1318 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:57.147132 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7d06ba29-9473-4cfb-9d86-01c5f0f49a59 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1363 microversion: 2.1 time: 0.432570 Oct 28 08:40:57.157327 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 114/229] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:56 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1363 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:57.158736 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5449e988-50ae-44b2-ae1d-c6044a769392 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:57.159705 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5449e988-50ae-44b2-ae1d-c6044a769392 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:57.165395 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-14a339d4-47e6-4e1e-80ae-a88e0501da3b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:57.166664 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-14a339d4-47e6-4e1e-80ae-a88e0501da3b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:57.168661 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5449e988-50ae-44b2-ae1d-c6044a769392 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:57.169594 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5449e988-50ae-44b2-ae1d-c6044a769392 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:57.170777 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5449e988-50ae-44b2-ae1d-c6044a769392 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:57.171876 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5449e988-50ae-44b2-ae1d-c6044a769392 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:57.174882 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14a339d4-47e6-4e1e-80ae-a88e0501da3b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:57.175534 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14a339d4-47e6-4e1e-80ae-a88e0501da3b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:57.176585 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14a339d4-47e6-4e1e-80ae-a88e0501da3b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:57.177204 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14a339d4-47e6-4e1e-80ae-a88e0501da3b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:57.594751 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-5449e988-50ae-44b2-ae1d-c6044a769392 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:57.605019 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5449e988-50ae-44b2-ae1d-c6044a769392 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1315 microversion: 2.1 time: 0.454749 Oct 28 08:40:57.605933 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-14a339d4-47e6-4e1e-80ae-a88e0501da3b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:57.615169 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-14a339d4-47e6-4e1e-80ae-a88e0501da3b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.476456 Oct 28 08:40:57.618576 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 115/230] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:57 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:57.618745 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 116/231] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:57 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:57.624045 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-551cc883-cf5f-4ad2-85a9-32cd1c4dce93 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:57.625543 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-551cc883-cf5f-4ad2-85a9-32cd1c4dce93 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:57.633368 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-551cc883-cf5f-4ad2-85a9-32cd1c4dce93 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:57.633816 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-551cc883-cf5f-4ad2-85a9-32cd1c4dce93 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:57.634671 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-551cc883-cf5f-4ad2-85a9-32cd1c4dce93 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:57.635157 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-551cc883-cf5f-4ad2-85a9-32cd1c4dce93 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:57.916954 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-551cc883-cf5f-4ad2-85a9-32cd1c4dce93 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:57.929378 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-551cc883-cf5f-4ad2-85a9-32cd1c4dce93 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:57.933520 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-551cc883-cf5f-4ad2-85a9-32cd1c4dce93 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:57.934566 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-551cc883-cf5f-4ad2-85a9-32cd1c4dce93 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1406 microversion: 2.20 time: 0.314716 Oct 28 08:40:57.936039 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 117/232] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:57 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1406 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:40:58.152490 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cc88078e-6732-4a87-978f-09d4797c7fd7 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:58.153020 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cc88078e-6732-4a87-978f-09d4797c7fd7 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:58.159312 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc88078e-6732-4a87-978f-09d4797c7fd7 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:58.160057 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc88078e-6732-4a87-978f-09d4797c7fd7 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:58.161089 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc88078e-6732-4a87-978f-09d4797c7fd7 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:58.161595 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc88078e-6732-4a87-978f-09d4797c7fd7 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:58.164360 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-335243ca-4a0d-4a49-b4a7-a6bea74f29d7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:58.165055 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-335243ca-4a0d-4a49-b4a7-a6bea74f29d7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:58.170773 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-335243ca-4a0d-4a49-b4a7-a6bea74f29d7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:58.171854 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-335243ca-4a0d-4a49-b4a7-a6bea74f29d7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:58.173070 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-335243ca-4a0d-4a49-b4a7-a6bea74f29d7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:58.173565 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-335243ca-4a0d-4a49-b4a7-a6bea74f29d7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:58.424777 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-cc88078e-6732-4a87-978f-09d4797c7fd7 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:58.433086 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cc88078e-6732-4a87-978f-09d4797c7fd7 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1508 microversion: 2.1 time: 0.284263 Oct 28 08:40:58.433961 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 116/233] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:58 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1508 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:58.456068 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-335243ca-4a0d-4a49-b4a7-a6bea74f29d7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:58.464834 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-335243ca-4a0d-4a49-b4a7-a6bea74f29d7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1363 microversion: 2.1 time: 0.304209 Oct 28 08:40:58.465522 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 118/234] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:58 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1363 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:58.622323 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8a91c1e6-e062-4974-bcea-630504f7f8c0 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:58.622947 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8a91c1e6-e062-4974-bcea-630504f7f8c0 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:58.629460 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a91c1e6-e062-4974-bcea-630504f7f8c0 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:58.629925 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a91c1e6-e062-4974-bcea-630504f7f8c0 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:58.631004 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a91c1e6-e062-4974-bcea-630504f7f8c0 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:58.631435 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a91c1e6-e062-4974-bcea-630504f7f8c0 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:58.635171 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1212051f-f0e7-4b29-b5f4-a90c261b88b2 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:58.635990 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1212051f-f0e7-4b29-b5f4-a90c261b88b2 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:58.644955 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1212051f-f0e7-4b29-b5f4-a90c261b88b2 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:58.645426 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1212051f-f0e7-4b29-b5f4-a90c261b88b2 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:58.646162 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1212051f-f0e7-4b29-b5f4-a90c261b88b2 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:58.646624 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1212051f-f0e7-4b29-b5f4-a90c261b88b2 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:58.860342 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-8a91c1e6-e062-4974-bcea-630504f7f8c0 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:58.867865 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-1212051f-f0e7-4b29-b5f4-a90c261b88b2 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:58.868023 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8a91c1e6-e062-4974-bcea-630504f7f8c0 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1501 microversion: 2.1 time: 0.249081 Oct 28 08:40:58.868442 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 117/235] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:58 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1501 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:58.876561 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1212051f-f0e7-4b29-b5f4-a90c261b88b2 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.245026 Oct 28 08:40:58.877127 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 119/236] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:58 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:40:58.952827 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dc54a7ab-fe9f-433f-b218-b543ef906efe tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:58.953426 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dc54a7ab-fe9f-433f-b218-b543ef906efe tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:58.959695 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc54a7ab-fe9f-433f-b218-b543ef906efe tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:58.960561 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc54a7ab-fe9f-433f-b218-b543ef906efe tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:58.961417 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc54a7ab-fe9f-433f-b218-b543ef906efe tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:58.961792 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc54a7ab-fe9f-433f-b218-b543ef906efe tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:59.091764 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-dc54a7ab-fe9f-433f-b218-b543ef906efe tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:59.100517 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-dc54a7ab-fe9f-433f-b218-b543ef906efe tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:59.102001 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-dc54a7ab-fe9f-433f-b218-b543ef906efe tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:59.103178 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dc54a7ab-fe9f-433f-b218-b543ef906efe tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1597 microversion: 2.20 time: 0.153986 Oct 28 08:40:59.103732 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 118/237] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:40:58 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1597 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:40:59.124053 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9b4387aa-7bb6-45b0-9c34-0b4c827bf09c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:59.125459 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9b4387aa-7bb6-45b0-9c34-0b4c827bf09c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:59.133893 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9b4387aa-7bb6-45b0-9c34-0b4c827bf09c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:59.134603 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9b4387aa-7bb6-45b0-9c34-0b4c827bf09c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:59.135669 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9b4387aa-7bb6-45b0-9c34-0b4c827bf09c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:59.139084 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9b4387aa-7bb6-45b0-9c34-0b4c827bf09c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:59.242367 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9b4387aa-7bb6-45b0-9c34-0b4c827bf09c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.122572 Oct 28 08:40:59.243277 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 120/238] 10.222.0.76 () {60 vars in 1315 bytes} [Thu Oct 28 08:40:59 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:40:59.483348 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5b9aeb33-d8c8-450e-8bf4-c68e6e24933e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:59.484542 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5b9aeb33-d8c8-450e-8bf4-c68e6e24933e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:59.490920 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b9aeb33-d8c8-450e-8bf4-c68e6e24933e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:59.492613 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b9aeb33-d8c8-450e-8bf4-c68e6e24933e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:59.493729 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b9aeb33-d8c8-450e-8bf4-c68e6e24933e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:59.496427 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b9aeb33-d8c8-450e-8bf4-c68e6e24933e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:59.661578 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-5b9aeb33-d8c8-450e-8bf4-c68e6e24933e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:40:59.669956 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5b9aeb33-d8c8-450e-8bf4-c68e6e24933e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1548 microversion: 2.1 time: 0.190577 Oct 28 08:40:59.678408 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 119/239] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:59 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1548 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:40:59.690382 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5738d92f-bc6b-43b7-8bab-225cba810227 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:59.691111 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5738d92f-bc6b-43b7-8bab-225cba810227 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:59.700227 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5738d92f-bc6b-43b7-8bab-225cba810227 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:59.701124 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5738d92f-bc6b-43b7-8bab-225cba810227 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:59.702007 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5738d92f-bc6b-43b7-8bab-225cba810227 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:59.703138 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5738d92f-bc6b-43b7-8bab-225cba810227 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:59.820326 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5738d92f-bc6b-43b7-8bab-225cba810227 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.134218 Oct 28 08:40:59.822107 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 121/240] 10.222.0.76 () {58 vars in 1274 bytes} [Thu Oct 28 08:40:59 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:40:59.895143 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f97b0eac-29bc-4bb5-9ea8-a0841c7610e0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:40:59.896065 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f97b0eac-29bc-4bb5-9ea8-a0841c7610e0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:40:59.901972 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f97b0eac-29bc-4bb5-9ea8-a0841c7610e0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:59.902601 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f97b0eac-29bc-4bb5-9ea8-a0841c7610e0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:40:59.903791 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f97b0eac-29bc-4bb5-9ea8-a0841c7610e0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:40:59.904313 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f97b0eac-29bc-4bb5-9ea8-a0841c7610e0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:00.108805 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-f97b0eac-29bc-4bb5-9ea8-a0841c7610e0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:00.122593 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f97b0eac-29bc-4bb5-9ea8-a0841c7610e0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.231194 Oct 28 08:41:00.123751 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 120/241] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:40:59 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:00.885692 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e718d212-8e34-42ca-91e8-8001a7bb151d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2cb1082-dfa1-45d6-aa6c-cb4c98524734"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:00.886819 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e718d212-8e34-42ca-91e8-8001a7bb151d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:00.894295 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e718d212-8e34-42ca-91e8-8001a7bb151d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:00.894747 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e718d212-8e34-42ca-91e8-8001a7bb151d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:00.895698 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e718d212-8e34-42ca-91e8-8001a7bb151d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:00.896275 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e718d212-8e34-42ca-91e8-8001a7bb151d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:01.142545 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8ec4efa5-7d46-4930-a8bf-afcfb7079a0c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:01.143320 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8ec4efa5-7d46-4930-a8bf-afcfb7079a0c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:01.150060 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ec4efa5-7d46-4930-a8bf-afcfb7079a0c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:01.150533 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ec4efa5-7d46-4930-a8bf-afcfb7079a0c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:01.151343 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ec4efa5-7d46-4930-a8bf-afcfb7079a0c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:01.151798 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ec4efa5-7d46-4930-a8bf-afcfb7079a0c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:01.313565 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-8ec4efa5-7d46-4930-a8bf-afcfb7079a0c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:01.321182 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8ec4efa5-7d46-4930-a8bf-afcfb7079a0c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.183584 Oct 28 08:41:01.322374 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 121/242] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:01 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:01.603479 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fe98b7c0-f3b0-4850-984c-54270edb3584 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:01.604634 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fe98b7c0-f3b0-4850-984c-54270edb3584 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:01.613581 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe98b7c0-f3b0-4850-984c-54270edb3584 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:01.614375 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe98b7c0-f3b0-4850-984c-54270edb3584 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:01.615414 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe98b7c0-f3b0-4850-984c-54270edb3584 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:01.616144 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe98b7c0-f3b0-4850-984c-54270edb3584 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:05.746456 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fe98b7c0-f3b0-4850-984c-54270edb3584 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 14 microversion: 2.20 time: 4.148743 Oct 28 08:41:05.748045 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 122/243] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:01 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 14 bytes in 4151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:05.754260 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-d921aa21-aa5a-462c-83aa-ce47eaa05f26 req-2eb5a0c5-f399-4a45-a251-d26b2e21d76f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e3ca69d-4e09-4205-b6ec-2a6189724e46", "tag": "b51a5869-7eac-401f-ad13-59a689851a50"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:05.756220 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:41:05.756220 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:41:05.764498 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d921aa21-aa5a-462c-83aa-ce47eaa05f26 req-2eb5a0c5-f399-4a45-a251-d26b2e21d76f service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:05.765137 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d921aa21-aa5a-462c-83aa-ce47eaa05f26 req-2eb5a0c5-f399-4a45-a251-d26b2e21d76f service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:05.776346 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-d921aa21-aa5a-462c-83aa-ce47eaa05f26 req-2eb5a0c5-f399-4a45-a251-d26b2e21d76f service nova] Creating event network-changed:b51a5869-7eac-401f-ad13-59a689851a50 for instance 4e3ca69d-4e09-4205-b6ec-2a6189724e46 on hv-cinder-81565 Oct 28 08:41:05.781410 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-d921aa21-aa5a-462c-83aa-ce47eaa05f26 req-2eb5a0c5-f399-4a45-a251-d26b2e21d76f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031993 Oct 28 08:41:05.782339 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 123/244] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:41:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:41:05.787087 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f1e9dfac-1432-4335-b75c-c14d120175d4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:05.788090 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f1e9dfac-1432-4335-b75c-c14d120175d4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:05.794528 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1e9dfac-1432-4335-b75c-c14d120175d4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:05.794986 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1e9dfac-1432-4335-b75c-c14d120175d4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:05.795754 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1e9dfac-1432-4335-b75c-c14d120175d4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:05.796185 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1e9dfac-1432-4335-b75c-c14d120175d4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:05.872398 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f1e9dfac-1432-4335-b75c-c14d120175d4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 14 microversion: 2.1 time: 0.088843 Oct 28 08:41:05.878335 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 124/245] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:05 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:41:05.879399 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7ef7e7fb-f6ba-489f-a548-056d733080ab tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:05.880096 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7ef7e7fb-f6ba-489f-a548-056d733080ab tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:05.887891 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ef7e7fb-f6ba-489f-a548-056d733080ab tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:05.888398 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ef7e7fb-f6ba-489f-a548-056d733080ab tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:05.889280 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ef7e7fb-f6ba-489f-a548-056d733080ab tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:05.889701 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ef7e7fb-f6ba-489f-a548-056d733080ab tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:05.922800 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e718d212-8e34-42ca-91e8-8001a7bb151d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "POST /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.040313 Oct 28 08:41:05.924030 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 122/246] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Oct 28 08:41:00 2021] POST /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f/os-volume_attachments => generated 194 bytes in 5043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:41:06.139555 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-7ef7e7fb-f6ba-489f-a548-056d733080ab tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:06.147431 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7ef7e7fb-f6ba-489f-a548-056d733080ab tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.272659 Oct 28 08:41:06.147996 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 125/247] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:05 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:06.758689 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e6fe2e2c-9569-4416-b13b-1dc16355f4a6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:06.759854 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e6fe2e2c-9569-4416-b13b-1dc16355f4a6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:06.766625 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e6fe2e2c-9569-4416-b13b-1dc16355f4a6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:06.767182 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e6fe2e2c-9569-4416-b13b-1dc16355f4a6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:06.768020 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e6fe2e2c-9569-4416-b13b-1dc16355f4a6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:06.768450 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e6fe2e2c-9569-4416-b13b-1dc16355f4a6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:06.839189 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e6fe2e2c-9569-4416-b13b-1dc16355f4a6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 14 microversion: 2.20 time: 0.084738 Oct 28 08:41:06.842414 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 123/248] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:06 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:06.886059 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e719d816-239f-4783-8966-308e675a8159 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:06.887094 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e719d816-239f-4783-8966-308e675a8159 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:06.894313 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e719d816-239f-4783-8966-308e675a8159 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:06.894785 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e719d816-239f-4783-8966-308e675a8159 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:06.895604 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e719d816-239f-4783-8966-308e675a8159 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:06.896139 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e719d816-239f-4783-8966-308e675a8159 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:06.977040 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e719d816-239f-4783-8966-308e675a8159 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 14 microversion: 2.1 time: 0.094527 Oct 28 08:41:06.977671 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 126/249] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:06 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:41:07.164798 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0f3e57bd-150d-4619-b55a-b97871c1b8b5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:07.165795 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0f3e57bd-150d-4619-b55a-b97871c1b8b5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:07.173838 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f3e57bd-150d-4619-b55a-b97871c1b8b5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:07.174346 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f3e57bd-150d-4619-b55a-b97871c1b8b5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:07.175216 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f3e57bd-150d-4619-b55a-b97871c1b8b5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:07.175768 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f3e57bd-150d-4619-b55a-b97871c1b8b5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:07.323771 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-0f3e57bd-150d-4619-b55a-b97871c1b8b5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:07.332526 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0f3e57bd-150d-4619-b55a-b97871c1b8b5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.171479 Oct 28 08:41:07.333130 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 124/250] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:07 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:07.634394 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-31c9c9e7-157e-436a-bd61-8e01682a647a tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6cbc905b-58f2-4852-8efc-a75308d4ade9"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:07.635774 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-31c9c9e7-157e-436a-bd61-8e01682a647a tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:07.642545 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31c9c9e7-157e-436a-bd61-8e01682a647a tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:07.642990 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31c9c9e7-157e-436a-bd61-8e01682a647a tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:07.643759 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31c9c9e7-157e-436a-bd61-8e01682a647a tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:07.644187 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31c9c9e7-157e-436a-bd61-8e01682a647a tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:07.801417 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-3f46c4eb-2abe-454b-a34e-8fd4f1c48f6f req-20883833-7c41-475f-b7c2-607d77d6047a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "914cd123-e872-418a-bf38-f477fe1551b3", "tag": "bc82b34a-5083-4fe6-8ca3-57d3482a7509"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:07.803032 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:41:07.803032 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:41:07.810870 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3f46c4eb-2abe-454b-a34e-8fd4f1c48f6f req-20883833-7c41-475f-b7c2-607d77d6047a service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:07.811300 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3f46c4eb-2abe-454b-a34e-8fd4f1c48f6f req-20883833-7c41-475f-b7c2-607d77d6047a service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:07.822469 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-3f46c4eb-2abe-454b-a34e-8fd4f1c48f6f req-20883833-7c41-475f-b7c2-607d77d6047a service nova] Creating event network-changed:bc82b34a-5083-4fe6-8ca3-57d3482a7509 for instance 914cd123-e872-418a-bf38-f477fe1551b3 on hv-cinder-81565 Oct 28 08:41:07.830631 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-3f46c4eb-2abe-454b-a34e-8fd4f1c48f6f req-20883833-7c41-475f-b7c2-607d77d6047a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030365 Oct 28 08:41:07.831746 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 125/251] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:41:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:41:07.851391 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e10c1bc1-c494-4710-9727-30c6299f8faf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:07.852424 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e10c1bc1-c494-4710-9727-30c6299f8faf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:07.859220 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e10c1bc1-c494-4710-9727-30c6299f8faf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:07.862523 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e10c1bc1-c494-4710-9727-30c6299f8faf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:07.862700 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e10c1bc1-c494-4710-9727-30c6299f8faf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:07.863159 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e10c1bc1-c494-4710-9727-30c6299f8faf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:07.941300 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-31c9c9e7-157e-436a-bd61-8e01682a647a tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "POST /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310992 Oct 28 08:41:07.942008 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 127/252] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Oct 28 08:41:07 2021] POST /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:41:07.973971 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e10c1bc1-c494-4710-9727-30c6299f8faf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 14 microversion: 2.20 time: 0.126318 Oct 28 08:41:07.975525 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 126/253] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:07 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:07.991329 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-947cd882-c631-4144-91a7-ae6f4d855cd4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:07.992392 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-947cd882-c631-4144-91a7-ae6f4d855cd4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:08.000233 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-947cd882-c631-4144-91a7-ae6f4d855cd4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:08.001468 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-947cd882-c631-4144-91a7-ae6f4d855cd4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:08.002727 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-947cd882-c631-4144-91a7-ae6f4d855cd4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:08.012548 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-947cd882-c631-4144-91a7-ae6f4d855cd4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:08.100899 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-947cd882-c631-4144-91a7-ae6f4d855cd4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 14 microversion: 2.1 time: 0.114008 Oct 28 08:41:08.101660 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 128/254] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:07 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:41:08.351371 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-03900611-7636-4138-821d-35ef616c35bb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:08.352099 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-03900611-7636-4138-821d-35ef616c35bb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:08.359110 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03900611-7636-4138-821d-35ef616c35bb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:08.360354 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03900611-7636-4138-821d-35ef616c35bb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:08.361237 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03900611-7636-4138-821d-35ef616c35bb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:08.361729 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03900611-7636-4138-821d-35ef616c35bb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:08.550619 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-03900611-7636-4138-821d-35ef616c35bb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:08.557915 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-03900611-7636-4138-821d-35ef616c35bb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.211956 Oct 28 08:41:08.558473 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 127/255] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:08 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:08.986433 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3457dd70-86b5-43a6-8962-c265404336dc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:08.987530 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3457dd70-86b5-43a6-8962-c265404336dc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:08.994906 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3457dd70-86b5-43a6-8962-c265404336dc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:08.995358 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3457dd70-86b5-43a6-8962-c265404336dc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:08.996132 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3457dd70-86b5-43a6-8962-c265404336dc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:08.996561 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3457dd70-86b5-43a6-8962-c265404336dc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:09.076744 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3457dd70-86b5-43a6-8962-c265404336dc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 14 microversion: 2.20 time: 0.094877 Oct 28 08:41:09.077892 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 129/256] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:08 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:09.112796 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b09ad72e-999f-4bd5-9b3e-85b60d218dac tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:09.113834 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b09ad72e-999f-4bd5-9b3e-85b60d218dac tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:09.120428 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b09ad72e-999f-4bd5-9b3e-85b60d218dac tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:09.120874 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b09ad72e-999f-4bd5-9b3e-85b60d218dac tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:09.121675 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b09ad72e-999f-4bd5-9b3e-85b60d218dac tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:09.122108 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b09ad72e-999f-4bd5-9b3e-85b60d218dac tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:09.212860 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b09ad72e-999f-4bd5-9b3e-85b60d218dac tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 14 microversion: 2.1 time: 0.104466 Oct 28 08:41:09.213424 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 128/257] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:09 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:41:09.575120 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f5e419d2-3b08-49ce-b94f-228d8149daf7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:09.575828 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f5e419d2-3b08-49ce-b94f-228d8149daf7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:09.583016 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5e419d2-3b08-49ce-b94f-228d8149daf7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:09.583456 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5e419d2-3b08-49ce-b94f-228d8149daf7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:09.584221 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5e419d2-3b08-49ce-b94f-228d8149daf7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:09.584647 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5e419d2-3b08-49ce-b94f-228d8149daf7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:09.727879 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-f5e419d2-3b08-49ce-b94f-228d8149daf7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:09.735272 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f5e419d2-3b08-49ce-b94f-228d8149daf7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.164037 Oct 28 08:41:09.736075 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 130/258] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:09 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:10.087709 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-161739dd-a4fc-4afa-a813-f96169e87925 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:10.088926 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-161739dd-a4fc-4afa-a813-f96169e87925 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:10.101577 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-161739dd-a4fc-4afa-a813-f96169e87925 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:10.102134 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-161739dd-a4fc-4afa-a813-f96169e87925 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:10.103030 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-161739dd-a4fc-4afa-a813-f96169e87925 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:10.103468 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-161739dd-a4fc-4afa-a813-f96169e87925 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:10.182560 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-161739dd-a4fc-4afa-a813-f96169e87925 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 14 microversion: 2.20 time: 0.098777 Oct 28 08:41:10.183199 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 129/259] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:10 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:10.224694 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-485f924e-547d-4071-9e44-60fbfd7b5f2d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:10.225741 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-485f924e-547d-4071-9e44-60fbfd7b5f2d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:10.232013 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-485f924e-547d-4071-9e44-60fbfd7b5f2d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:10.232523 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-485f924e-547d-4071-9e44-60fbfd7b5f2d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:10.233350 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-485f924e-547d-4071-9e44-60fbfd7b5f2d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:10.233846 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-485f924e-547d-4071-9e44-60fbfd7b5f2d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:10.307859 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-485f924e-547d-4071-9e44-60fbfd7b5f2d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 14 microversion: 2.1 time: 0.087736 Oct 28 08:41:10.308712 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 131/260] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:10 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:41:10.753810 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f506932a-de74-4378-9437-27bebdd5be7e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:10.754508 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f506932a-de74-4378-9437-27bebdd5be7e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:10.761297 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f506932a-de74-4378-9437-27bebdd5be7e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:10.761742 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f506932a-de74-4378-9437-27bebdd5be7e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:10.762516 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f506932a-de74-4378-9437-27bebdd5be7e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:10.762952 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f506932a-de74-4378-9437-27bebdd5be7e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:10.909447 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-f506932a-de74-4378-9437-27bebdd5be7e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:10.917447 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f506932a-de74-4378-9437-27bebdd5be7e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.167915 Oct 28 08:41:10.918314 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 130/261] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:10 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:11.194380 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-847e3000-effd-402b-9b39-92313e7fc48d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:11.195827 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-847e3000-effd-402b-9b39-92313e7fc48d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:11.202779 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-847e3000-effd-402b-9b39-92313e7fc48d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:11.203065 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-847e3000-effd-402b-9b39-92313e7fc48d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:11.204076 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-847e3000-effd-402b-9b39-92313e7fc48d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:11.204535 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-847e3000-effd-402b-9b39-92313e7fc48d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:11.279000 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-847e3000-effd-402b-9b39-92313e7fc48d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 14 microversion: 2.20 time: 0.088477 Oct 28 08:41:11.280233 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 132/262] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:11 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:11.318386 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-636dc0dc-b2c6-4877-b6dd-e657325ec4c5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:11.319468 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-636dc0dc-b2c6-4877-b6dd-e657325ec4c5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:11.325515 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-636dc0dc-b2c6-4877-b6dd-e657325ec4c5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:11.325956 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-636dc0dc-b2c6-4877-b6dd-e657325ec4c5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:11.326749 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-636dc0dc-b2c6-4877-b6dd-e657325ec4c5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:11.327176 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-636dc0dc-b2c6-4877-b6dd-e657325ec4c5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:11.411986 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-636dc0dc-b2c6-4877-b6dd-e657325ec4c5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 14 microversion: 2.1 time: 0.097074 Oct 28 08:41:11.412783 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 131/263] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:11 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:41:11.936068 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8f7e5535-fe89-4458-9260-d5a315d86993 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:11.936787 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8f7e5535-fe89-4458-9260-d5a315d86993 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:11.944866 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f7e5535-fe89-4458-9260-d5a315d86993 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:11.945312 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f7e5535-fe89-4458-9260-d5a315d86993 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:11.946201 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f7e5535-fe89-4458-9260-d5a315d86993 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:11.946565 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f7e5535-fe89-4458-9260-d5a315d86993 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:12.175410 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-8f7e5535-fe89-4458-9260-d5a315d86993 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:12.185187 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8f7e5535-fe89-4458-9260-d5a315d86993 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.254083 Oct 28 08:41:12.186736 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 133/264] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:11 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:12.292692 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3f6cb6d5-1ef3-45dc-a23a-24319d7b0454 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:12.293717 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3f6cb6d5-1ef3-45dc-a23a-24319d7b0454 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:12.304805 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f6cb6d5-1ef3-45dc-a23a-24319d7b0454 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:12.305783 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f6cb6d5-1ef3-45dc-a23a-24319d7b0454 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:12.307918 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f6cb6d5-1ef3-45dc-a23a-24319d7b0454 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:12.309220 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f6cb6d5-1ef3-45dc-a23a-24319d7b0454 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:12.424810 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3581a487-edda-4ee4-91e8-98868d1abb63 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:12.426742 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3581a487-edda-4ee4-91e8-98868d1abb63 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:12.426885 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3f6cb6d5-1ef3-45dc-a23a-24319d7b0454 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 14 microversion: 2.20 time: 0.139278 Oct 28 08:41:12.427428 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 132/265] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:12 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:12.438955 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3581a487-edda-4ee4-91e8-98868d1abb63 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:12.439403 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3581a487-edda-4ee4-91e8-98868d1abb63 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:12.440351 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3581a487-edda-4ee4-91e8-98868d1abb63 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:12.440788 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3581a487-edda-4ee4-91e8-98868d1abb63 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:12.535192 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3581a487-edda-4ee4-91e8-98868d1abb63 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 14 microversion: 2.1 time: 0.114817 Oct 28 08:41:12.536201 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 134/266] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:12 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:41:13.203385 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-03b3da9c-bb66-48de-8ce4-2519aaaa40d9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:13.204907 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-03b3da9c-bb66-48de-8ce4-2519aaaa40d9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:13.212930 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03b3da9c-bb66-48de-8ce4-2519aaaa40d9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:13.213440 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03b3da9c-bb66-48de-8ce4-2519aaaa40d9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:13.214286 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03b3da9c-bb66-48de-8ce4-2519aaaa40d9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:13.214909 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03b3da9c-bb66-48de-8ce4-2519aaaa40d9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:13.352590 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-03b3da9c-bb66-48de-8ce4-2519aaaa40d9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:13.361643 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-03b3da9c-bb66-48de-8ce4-2519aaaa40d9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.162368 Oct 28 08:41:13.362222 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 133/267] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:13 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:13.438845 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e57fb7ab-d55e-43d7-8321-6e29ecf65792 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:13.440008 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e57fb7ab-d55e-43d7-8321-6e29ecf65792 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:13.448318 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e57fb7ab-d55e-43d7-8321-6e29ecf65792 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:13.448767 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e57fb7ab-d55e-43d7-8321-6e29ecf65792 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:13.449654 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e57fb7ab-d55e-43d7-8321-6e29ecf65792 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:13.450178 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e57fb7ab-d55e-43d7-8321-6e29ecf65792 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:13.545605 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-88462980-df9e-4f42-8213-8438ab2d7b3b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:13.546875 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-88462980-df9e-4f42-8213-8438ab2d7b3b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:13.554100 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88462980-df9e-4f42-8213-8438ab2d7b3b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:13.554569 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88462980-df9e-4f42-8213-8438ab2d7b3b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:13.555338 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88462980-df9e-4f42-8213-8438ab2d7b3b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:13.556437 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88462980-df9e-4f42-8213-8438ab2d7b3b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:13.563399 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e57fb7ab-d55e-43d7-8321-6e29ecf65792 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 14 microversion: 2.20 time: 0.129288 Oct 28 08:41:13.564403 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 135/268] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:13 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:13.681503 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-88462980-df9e-4f42-8213-8438ab2d7b3b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 14 microversion: 2.1 time: 0.139232 Oct 28 08:41:13.682262 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 134/269] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:13 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 08:41:13.960444 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4a6567b1-934c-4370-8151-f22a0082b3bc tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-81840540", "imageRef": "339e99be-6a19-4324-aa16-6b690c25dede", "flavorRef": "452", "networks": [{"uuid": "35415b19-1403-4733-b6cb-03e1bd171af3"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:14.014487 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-4a6567b1-934c-4370-8151-f22a0082b3bc tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] validate_networks() for [('35415b19-1403-4733-b6cb-03e1bd171af3', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:41:14.379026 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0abf24f6-b98c-4301-be27-18bb33509463 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:14.380025 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0abf24f6-b98c-4301-be27-18bb33509463 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:14.387284 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0abf24f6-b98c-4301-be27-18bb33509463 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:14.388044 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0abf24f6-b98c-4301-be27-18bb33509463 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:14.388877 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0abf24f6-b98c-4301-be27-18bb33509463 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:14.389366 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0abf24f6-b98c-4301-be27-18bb33509463 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:14.396674 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-4a6567b1-934c-4370-8151-f22a0082b3bc tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:41:14.397088 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-4a6567b1-934c-4370-8151-f22a0082b3bc tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:41:14.397548 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-4a6567b1-934c-4370-8151-f22a0082b3bc tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:41:14.398030 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-4a6567b1-934c-4370-8151-f22a0082b3bc tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:41:14.399046 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-4a6567b1-934c-4370-8151-f22a0082b3bc tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:41:14.409189 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a6567b1-934c-4370-8151-f22a0082b3bc tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:14.409923 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a6567b1-934c-4370-8151-f22a0082b3bc tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:14.410722 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a6567b1-934c-4370-8151-f22a0082b3bc tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:14.411148 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a6567b1-934c-4370-8151-f22a0082b3bc tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:14.429852 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-4a6567b1-934c-4370-8151-f22a0082b3bc tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Getting quotas for project 273c545d66f0479bb21eb8012fb29558. Resources: {'instances', 'cores', 'ram'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:41:14.433979 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-4a6567b1-934c-4370-8151-f22a0082b3bc tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Getting quotas for user 5df79cdd584947ff967966692375c45c and project 273c545d66f0479bb21eb8012fb29558. Resources: {'instances', 'cores', 'ram'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:41:14.452243 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4a6567b1-934c-4370-8151-f22a0082b3bc tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:41:14.455952 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4a6567b1-934c-4370-8151-f22a0082b3bc tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 91e77c4e-c82e-4295-811a-8d992ea9209c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='339e99be-6a19-4324-aa16-6b690c25dede',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:41:14.511252 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4a6567b1-934c-4370-8151-f22a0082b3bc tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557040 Oct 28 08:41:14.512135 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 136/270] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Oct 28 08:41:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:41:14.523548 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-47898321-f9e4-4380-b1d7-9400297e3701 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:14.524466 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-47898321-f9e4-4380-b1d7-9400297e3701 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 91e77c4e-c82e-4295-811a-8d992ea9209c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:14.546530 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-0abf24f6-b98c-4301-be27-18bb33509463 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:14.556206 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0abf24f6-b98c-4301-be27-18bb33509463 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.181426 Oct 28 08:41:14.557029 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 135/271] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:14 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:14.574357 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c3b4501b-e1d9-4e2d-86f6-88df618a9e02 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:14.575304 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c3b4501b-e1d9-4e2d-86f6-88df618a9e02 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:14.585164 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-47898321-f9e4-4380-b1d7-9400297e3701 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:14.585415 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3b4501b-e1d9-4e2d-86f6-88df618a9e02 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:14.586607 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3b4501b-e1d9-4e2d-86f6-88df618a9e02 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:14.588248 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3b4501b-e1d9-4e2d-86f6-88df618a9e02 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:14.589274 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3b4501b-e1d9-4e2d-86f6-88df618a9e02 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:14.592636 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-47898321-f9e4-4380-b1d7-9400297e3701 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c" status: 200 len: 1212 microversion: 2.1 time: 0.072705 Oct 28 08:41:14.593749 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 137/272] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:14 2021] GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c => generated 1212 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:14.677003 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c3b4501b-e1d9-4e2d-86f6-88df618a9e02 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 14 microversion: 2.20 time: 0.106134 Oct 28 08:41:14.677947 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 136/273] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:14 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:14.694401 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6831591e-a705-440d-81e2-3b1760e1d692 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:14.695676 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6831591e-a705-440d-81e2-3b1760e1d692 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:14.702783 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6831591e-a705-440d-81e2-3b1760e1d692 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:14.703215 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6831591e-a705-440d-81e2-3b1760e1d692 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:14.703984 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6831591e-a705-440d-81e2-3b1760e1d692 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:14.704934 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6831591e-a705-440d-81e2-3b1760e1d692 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:14.795755 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6831591e-a705-440d-81e2-3b1760e1d692 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 14 microversion: 2.1 time: 0.107086 Oct 28 08:41:14.796511 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 138/274] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:14 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:41:15.578361 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-39f7b898-cb0c-4b87-af6f-f9e0a0954ff0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:15.580071 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-39f7b898-cb0c-4b87-af6f-f9e0a0954ff0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:15.587409 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39f7b898-cb0c-4b87-af6f-f9e0a0954ff0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:15.587847 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39f7b898-cb0c-4b87-af6f-f9e0a0954ff0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:15.588802 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39f7b898-cb0c-4b87-af6f-f9e0a0954ff0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:15.589226 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39f7b898-cb0c-4b87-af6f-f9e0a0954ff0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:15.637049 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-aef8201f-9c17-4398-9193-ee3c69e321d8 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:15.647510 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-aef8201f-9c17-4398-9193-ee3c69e321d8 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 91e77c4e-c82e-4295-811a-8d992ea9209c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:15.657048 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aef8201f-9c17-4398-9193-ee3c69e321d8 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:15.658105 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aef8201f-9c17-4398-9193-ee3c69e321d8 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:15.658966 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aef8201f-9c17-4398-9193-ee3c69e321d8 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:15.659406 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aef8201f-9c17-4398-9193-ee3c69e321d8 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:15.753074 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-aef8201f-9c17-4398-9193-ee3c69e321d8 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:15.756780 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-39f7b898-cb0c-4b87-af6f-f9e0a0954ff0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:15.761913 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-aef8201f-9c17-4398-9193-ee3c69e321d8 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c" status: 200 len: 1264 microversion: 2.1 time: 0.151632 Oct 28 08:41:15.762706 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 139/275] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:15 2021] GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:15.765054 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-39f7b898-cb0c-4b87-af6f-f9e0a0954ff0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.194749 Oct 28 08:41:15.769453 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bbe196b6-78f1-4fd2-9e5e-968c46088995 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:15.770626 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bbe196b6-78f1-4fd2-9e5e-968c46088995 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:15.775515 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 137/276] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:15 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:15.776552 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bbe196b6-78f1-4fd2-9e5e-968c46088995 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:15.777006 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bbe196b6-78f1-4fd2-9e5e-968c46088995 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:15.777774 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bbe196b6-78f1-4fd2-9e5e-968c46088995 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:15.778234 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bbe196b6-78f1-4fd2-9e5e-968c46088995 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:15.810248 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-edc98611-f922-4926-961a-34220acf313e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:15.810248 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-edc98611-f922-4926-961a-34220acf313e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:15.814657 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edc98611-f922-4926-961a-34220acf313e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:15.815213 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edc98611-f922-4926-961a-34220acf313e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:15.815992 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edc98611-f922-4926-961a-34220acf313e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:15.816422 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edc98611-f922-4926-961a-34220acf313e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:15.891231 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bbe196b6-78f1-4fd2-9e5e-968c46088995 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 14 microversion: 2.20 time: 0.126549 Oct 28 08:41:15.894046 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 140/277] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:15 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:15.916320 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-edc98611-f922-4926-961a-34220acf313e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 14 microversion: 2.1 time: 0.113273 Oct 28 08:41:15.917225 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 138/278] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:15 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:41:16.786325 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d2c19644-0640-496b-9412-88b2fdf8ba4a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:16.787075 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d2c19644-0640-496b-9412-88b2fdf8ba4a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 91e77c4e-c82e-4295-811a-8d992ea9209c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:16.789455 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c31e4ee0-a81f-4152-a97c-7c2ed440dfb5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:16.790231 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c31e4ee0-a81f-4152-a97c-7c2ed440dfb5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:16.802215 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2c19644-0640-496b-9412-88b2fdf8ba4a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:16.802703 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2c19644-0640-496b-9412-88b2fdf8ba4a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:16.803541 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2c19644-0640-496b-9412-88b2fdf8ba4a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:16.803987 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2c19644-0640-496b-9412-88b2fdf8ba4a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:16.810607 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c31e4ee0-a81f-4152-a97c-7c2ed440dfb5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:16.811056 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c31e4ee0-a81f-4152-a97c-7c2ed440dfb5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:16.811845 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c31e4ee0-a81f-4152-a97c-7c2ed440dfb5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:16.812280 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c31e4ee0-a81f-4152-a97c-7c2ed440dfb5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:17.163412 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c31e4ee0-a81f-4152-a97c-7c2ed440dfb5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:17.174325 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c31e4ee0-a81f-4152-a97c-7c2ed440dfb5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.395572 Oct 28 08:41:17.180595 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 139/279] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:16 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:17.190864 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-d2c19644-0640-496b-9412-88b2fdf8ba4a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:17.193828 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3242d523-953f-4ad7-b1b1-5df1456203f5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:17.194786 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3242d523-953f-4ad7-b1b1-5df1456203f5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:17.200586 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d2c19644-0640-496b-9412-88b2fdf8ba4a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c" status: 200 len: 1312 microversion: 2.1 time: 0.423941 Oct 28 08:41:17.202088 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 141/280] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:16 2021] GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c => generated 1312 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:17.209442 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cd314696-8209-49bb-8a72-9cd3e899e13f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:17.210738 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cd314696-8209-49bb-8a72-9cd3e899e13f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:17.213116 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3242d523-953f-4ad7-b1b1-5df1456203f5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:17.213686 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3242d523-953f-4ad7-b1b1-5df1456203f5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:17.214468 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3242d523-953f-4ad7-b1b1-5df1456203f5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:17.214924 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3242d523-953f-4ad7-b1b1-5df1456203f5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:17.222366 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd314696-8209-49bb-8a72-9cd3e899e13f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:17.223108 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd314696-8209-49bb-8a72-9cd3e899e13f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:17.223893 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd314696-8209-49bb-8a72-9cd3e899e13f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:17.224683 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd314696-8209-49bb-8a72-9cd3e899e13f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:17.367042 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cd314696-8209-49bb-8a72-9cd3e899e13f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 14 microversion: 2.1 time: 0.162912 Oct 28 08:41:17.377284 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 142/281] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:17 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 14 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:41:17.384578 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c8eb1ea8-8bfa-43c6-b557-a3d89daf2635 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-133632010", "imageRef": "339e99be-6a19-4324-aa16-6b690c25dede", "flavorRef": "452", "networks": [{"uuid": "baa97c96-d90c-4541-963c-2b8ac01daede"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:17.401012 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3242d523-953f-4ad7-b1b1-5df1456203f5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 6451 microversion: 2.20 time: 0.210673 Oct 28 08:41:17.401658 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 140/282] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:17 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 6451 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:41:17.458953 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-c8eb1ea8-8bfa-43c6-b557-a3d89daf2635 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] validate_networks() for [('baa97c96-d90c-4541-963c-2b8ac01daede', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:41:18.192889 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-64c15652-1fec-43a2-9286-91d8e1952591 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:18.193781 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-64c15652-1fec-43a2-9286-91d8e1952591 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:18.201005 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64c15652-1fec-43a2-9286-91d8e1952591 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:18.201527 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64c15652-1fec-43a2-9286-91d8e1952591 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:18.202410 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64c15652-1fec-43a2-9286-91d8e1952591 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:18.202897 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64c15652-1fec-43a2-9286-91d8e1952591 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:18.512600 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-c8eb1ea8-8bfa-43c6-b557-a3d89daf2635 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:41:18.513570 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-c8eb1ea8-8bfa-43c6-b557-a3d89daf2635 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:41:18.514046 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-c8eb1ea8-8bfa-43c6-b557-a3d89daf2635 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:41:18.514445 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-c8eb1ea8-8bfa-43c6-b557-a3d89daf2635 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:41:18.514952 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-c8eb1ea8-8bfa-43c6-b557-a3d89daf2635 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:41:18.524445 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8eb1ea8-8bfa-43c6-b557-a3d89daf2635 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:18.524963 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8eb1ea8-8bfa-43c6-b557-a3d89daf2635 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:18.525811 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8eb1ea8-8bfa-43c6-b557-a3d89daf2635 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:18.526334 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8eb1ea8-8bfa-43c6-b557-a3d89daf2635 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:18.544593 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-c8eb1ea8-8bfa-43c6-b557-a3d89daf2635 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Getting quotas for project 3831003e70cf4a62afb1393fbea6654e. Resources: {'instances', 'cores', 'ram'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:41:18.548829 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-c8eb1ea8-8bfa-43c6-b557-a3d89daf2635 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Getting quotas for user e0a3f84e4d9b4c77aab465f1e4df493d and project 3831003e70cf4a62afb1393fbea6654e. Resources: {'instances', 'cores', 'ram'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:41:18.560008 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c8eb1ea8-8bfa-43c6-b557-a3d89daf2635 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:41:18.562492 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c8eb1ea8-8bfa-43c6-b557-a3d89daf2635 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 047748f3-80f4-4fd5-a32a-18bf0a4a6e32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='339e99be-6a19-4324-aa16-6b690c25dede',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:41:18.614113 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c8eb1ea8-8bfa-43c6-b557-a3d89daf2635 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.234553 Oct 28 08:41:18.615097 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 143/283] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Oct 28 08:41:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:41:18.619218 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1c9ec3a2-26ac-4e0e-99b2-22742cc04e30 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:18.620356 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1c9ec3a2-26ac-4e0e-99b2-22742cc04e30 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 91e77c4e-c82e-4295-811a-8d992ea9209c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:18.629229 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c9ec3a2-26ac-4e0e-99b2-22742cc04e30 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:18.630455 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-64c15652-1fec-43a2-9286-91d8e1952591 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:18.630874 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c9ec3a2-26ac-4e0e-99b2-22742cc04e30 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:18.631841 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c9ec3a2-26ac-4e0e-99b2-22742cc04e30 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:18.632362 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c9ec3a2-26ac-4e0e-99b2-22742cc04e30 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:18.652639 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-64c15652-1fec-43a2-9286-91d8e1952591 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.464339 Oct 28 08:41:18.653231 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 141/284] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:18 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:18.670440 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9aca9f24-fa47-4424-b272-a77d276e9de1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:18.671730 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9aca9f24-fa47-4424-b272-a77d276e9de1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:18.678381 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9aca9f24-fa47-4424-b272-a77d276e9de1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:18.679047 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9aca9f24-fa47-4424-b272-a77d276e9de1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:18.680015 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9aca9f24-fa47-4424-b272-a77d276e9de1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:18.680540 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9aca9f24-fa47-4424-b272-a77d276e9de1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:18.783408 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9aca9f24-fa47-4424-b272-a77d276e9de1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 6451 microversion: 2.1 time: 0.128096 Oct 28 08:41:18.784029 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 142/285] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:18 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 6451 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:18.790088 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-13cb25e5-8d2e-4f8d-85ec-c73f9ba6ac74 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:18.791182 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-13cb25e5-8d2e-4f8d-85ec-c73f9ba6ac74 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:18.798199 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-13cb25e5-8d2e-4f8d-85ec-c73f9ba6ac74 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:18.798868 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-13cb25e5-8d2e-4f8d-85ec-c73f9ba6ac74 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:18.799615 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-13cb25e5-8d2e-4f8d-85ec-c73f9ba6ac74 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:18.800271 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-13cb25e5-8d2e-4f8d-85ec-c73f9ba6ac74 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:18.917095 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-13cb25e5-8d2e-4f8d-85ec-c73f9ba6ac74 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 10658 microversion: 2.20 time: 0.131054 Oct 28 08:41:18.917970 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 143/286] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:18 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 10658 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:41:18.926803 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1c9ec3a2-26ac-4e0e-99b2-22742cc04e30 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:18.932259 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-b2089815-3de2-4752-b6f5-a693368a9cc4 req-3e00e977-f5b5-48a3-9303-8ea655e4f61d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91e77c4e-c82e-4295-811a-8d992ea9209c", "tag": "5c920b6d-61e7-4b04-9084-e8c83a6b11c7"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:18.935809 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:41:18.935809 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:41:18.944537 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1c9ec3a2-26ac-4e0e-99b2-22742cc04e30 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c" status: 200 len: 1312 microversion: 2.1 time: 0.328443 Oct 28 08:41:18.945391 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 144/287] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:18 2021] GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c => generated 1312 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:18.948655 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b2089815-3de2-4752-b6f5-a693368a9cc4 req-3e00e977-f5b5-48a3-9303-8ea655e4f61d service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:18.949371 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b2089815-3de2-4752-b6f5-a693368a9cc4 req-3e00e977-f5b5-48a3-9303-8ea655e4f61d service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:18.950707 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1c77b486-1326-423a-bb20-7e26a8d680a5 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:18.951346 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1c77b486-1326-423a-bb20-7e26a8d680a5 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 047748f3-80f4-4fd5-a32a-18bf0a4a6e32] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:18.969337 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-b2089815-3de2-4752-b6f5-a693368a9cc4 req-3e00e977-f5b5-48a3-9303-8ea655e4f61d service nova] Creating event network-changed:5c920b6d-61e7-4b04-9084-e8c83a6b11c7 for instance 91e77c4e-c82e-4295-811a-8d992ea9209c on hv-cinder-81565 Oct 28 08:41:18.990291 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-b2089815-3de2-4752-b6f5-a693368a9cc4 req-3e00e977-f5b5-48a3-9303-8ea655e4f61d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070454 Oct 28 08:41:18.992378 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 144/288] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:41:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:41:19.059885 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1c77b486-1326-423a-bb20-7e26a8d680a5 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:19.070808 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1c77b486-1326-423a-bb20-7e26a8d680a5 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32" status: 200 len: 1217 microversion: 2.1 time: 0.124141 Oct 28 08:41:19.081991 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 145/289] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:18 2021] GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32 => generated 1217 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:19.679780 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fbb043c0-06e5-43cf-becd-1eed98e1cd62 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:19.681432 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fbb043c0-06e5-43cf-becd-1eed98e1cd62 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:19.692851 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbb043c0-06e5-43cf-becd-1eed98e1cd62 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:19.693578 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbb043c0-06e5-43cf-becd-1eed98e1cd62 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:19.694554 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbb043c0-06e5-43cf-becd-1eed98e1cd62 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:19.695125 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbb043c0-06e5-43cf-becd-1eed98e1cd62 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:19.799649 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-00dc52e9-ed83-4335-8059-386b81576488 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:19.802694 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-00dc52e9-ed83-4335-8059-386b81576488 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:19.817204 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00dc52e9-ed83-4335-8059-386b81576488 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:19.818338 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00dc52e9-ed83-4335-8059-386b81576488 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:19.820853 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00dc52e9-ed83-4335-8059-386b81576488 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:19.822139 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00dc52e9-ed83-4335-8059-386b81576488 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:19.915725 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-fbb043c0-06e5-43cf-becd-1eed98e1cd62 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:19.923955 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fbb043c0-06e5-43cf-becd-1eed98e1cd62 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.257111 Oct 28 08:41:19.924593 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 145/290] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:19 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:19.930737 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f16624e4-bb48-4c35-b14c-f1c57b099ae3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:19.932580 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f16624e4-bb48-4c35-b14c-f1c57b099ae3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:19.941968 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f16624e4-bb48-4c35-b14c-f1c57b099ae3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:19.942415 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f16624e4-bb48-4c35-b14c-f1c57b099ae3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:19.943234 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f16624e4-bb48-4c35-b14c-f1c57b099ae3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:19.943657 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f16624e4-bb48-4c35-b14c-f1c57b099ae3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:20.152090 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f16624e4-bb48-4c35-b14c-f1c57b099ae3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 14402 microversion: 2.20 time: 0.225746 Oct 28 08:41:20.152736 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 146/291] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:19 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 14402 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:41:20.158376 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2325f0c1-e0d9-4da1-bbb4-946d866a9072 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:20.159143 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2325f0c1-e0d9-4da1-bbb4-946d866a9072 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 91e77c4e-c82e-4295-811a-8d992ea9209c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:20.167698 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2325f0c1-e0d9-4da1-bbb4-946d866a9072 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:20.168194 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2325f0c1-e0d9-4da1-bbb4-946d866a9072 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:20.169440 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2325f0c1-e0d9-4da1-bbb4-946d866a9072 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:20.170130 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2325f0c1-e0d9-4da1-bbb4-946d866a9072 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:20.189212 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-00dc52e9-ed83-4335-8059-386b81576488 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 9751 microversion: 2.1 time: 0.396392 Oct 28 08:41:20.190755 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 146/292] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:19 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 9751 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:20.196149 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-52541520-ba45-4f85-8066-dffd80f2dc18 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:20.196896 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-52541520-ba45-4f85-8066-dffd80f2dc18 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 047748f3-80f4-4fd5-a32a-18bf0a4a6e32] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:20.204572 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-52541520-ba45-4f85-8066-dffd80f2dc18 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:20.205133 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-52541520-ba45-4f85-8066-dffd80f2dc18 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:20.206178 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-52541520-ba45-4f85-8066-dffd80f2dc18 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:20.206735 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-52541520-ba45-4f85-8066-dffd80f2dc18 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:20.311413 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-52541520-ba45-4f85-8066-dffd80f2dc18 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:20.320453 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-52541520-ba45-4f85-8066-dffd80f2dc18 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32" status: 200 len: 1269 microversion: 2.1 time: 0.128611 Oct 28 08:41:20.321126 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 147/293] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:20 2021] GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32 => generated 1269 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:20.440975 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-2325f0c1-e0d9-4da1-bbb4-946d866a9072 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:20.452453 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2325f0c1-e0d9-4da1-bbb4-946d866a9072 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c" status: 200 len: 1312 microversion: 2.1 time: 0.298479 Oct 28 08:41:20.453047 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 147/294] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:20 2021] GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c => generated 1312 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:20.948724 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9c2ccdde-9214-47f8-bd20-96bd1708d53c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:20.949312 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9c2ccdde-9214-47f8-bd20-96bd1708d53c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:20.956365 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c2ccdde-9214-47f8-bd20-96bd1708d53c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:20.956811 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c2ccdde-9214-47f8-bd20-96bd1708d53c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:20.957580 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c2ccdde-9214-47f8-bd20-96bd1708d53c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:20.958008 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c2ccdde-9214-47f8-bd20-96bd1708d53c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:21.165690 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6ece3ec6-952d-4837-ae57-63f62a273988 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:21.166861 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6ece3ec6-952d-4837-ae57-63f62a273988 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:21.175230 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ece3ec6-952d-4837-ae57-63f62a273988 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:21.175673 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ece3ec6-952d-4837-ae57-63f62a273988 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:21.176710 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ece3ec6-952d-4837-ae57-63f62a273988 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:21.177350 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ece3ec6-952d-4837-ae57-63f62a273988 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:21.218035 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-9c2ccdde-9214-47f8-bd20-96bd1708d53c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:21.228598 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9c2ccdde-9214-47f8-bd20-96bd1708d53c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.283497 Oct 28 08:41:21.229218 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 148/295] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:20 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:21.234032 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-65bc1740-957e-4752-a104-35b8d53a0800 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:21.234925 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-65bc1740-957e-4752-a104-35b8d53a0800 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:21.242541 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65bc1740-957e-4752-a104-35b8d53a0800 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:21.243314 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65bc1740-957e-4752-a104-35b8d53a0800 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:21.244333 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65bc1740-957e-4752-a104-35b8d53a0800 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:21.245150 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65bc1740-957e-4752-a104-35b8d53a0800 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:21.468822 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-65bc1740-957e-4752-a104-35b8d53a0800 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 13447 microversion: 2.1 time: 0.238273 Oct 28 08:41:21.475058 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 149/296] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:21 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 13447 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:21.477603 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9ebad142-6aac-4583-8a83-3cd129775b4b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:21.478297 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9ebad142-6aac-4583-8a83-3cd129775b4b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 047748f3-80f4-4fd5-a32a-18bf0a4a6e32] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:21.485728 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ebad142-6aac-4583-8a83-3cd129775b4b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:21.486381 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ebad142-6aac-4583-8a83-3cd129775b4b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:21.487437 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ebad142-6aac-4583-8a83-3cd129775b4b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:21.487780 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ebad142-6aac-4583-8a83-3cd129775b4b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:21.502106 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6ece3ec6-952d-4837-ae57-63f62a273988 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 16235 microversion: 2.20 time: 0.339372 Oct 28 08:41:21.508138 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 148/297] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:21 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 16235 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:41:21.511758 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3f16e344-f8eb-4c58-90b8-20e1279032c4 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:21.512493 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3f16e344-f8eb-4c58-90b8-20e1279032c4 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 91e77c4e-c82e-4295-811a-8d992ea9209c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:21.520411 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f16e344-f8eb-4c58-90b8-20e1279032c4 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:21.520851 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f16e344-f8eb-4c58-90b8-20e1279032c4 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:21.521861 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f16e344-f8eb-4c58-90b8-20e1279032c4 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:21.522304 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f16e344-f8eb-4c58-90b8-20e1279032c4 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:21.742317 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-9ebad142-6aac-4583-8a83-3cd129775b4b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:21.754153 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9ebad142-6aac-4583-8a83-3cd129775b4b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32" status: 200 len: 1317 microversion: 2.1 time: 0.282246 Oct 28 08:41:21.755135 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 150/298] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:21 2021] GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32 => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:21.775773 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-3f16e344-f8eb-4c58-90b8-20e1279032c4 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:21.785232 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3f16e344-f8eb-4c58-90b8-20e1279032c4 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c" status: 200 len: 1312 microversion: 2.1 time: 0.281000 Oct 28 08:41:21.786189 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 149/299] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:21 2021] GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c => generated 1312 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:22.246298 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f8b8c8a2-e554-4a2b-b6fd-00cf97e1b8d7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:22.247495 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f8b8c8a2-e554-4a2b-b6fd-00cf97e1b8d7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:22.257553 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8b8c8a2-e554-4a2b-b6fd-00cf97e1b8d7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:22.258305 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8b8c8a2-e554-4a2b-b6fd-00cf97e1b8d7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:22.259572 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8b8c8a2-e554-4a2b-b6fd-00cf97e1b8d7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:22.260241 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8b8c8a2-e554-4a2b-b6fd-00cf97e1b8d7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:22.306624 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-ed1f264a-bb27-41af-936d-332b641f3d82 req-2bc88820-89f8-4f69-8165-e30bbb6b696b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "047748f3-80f4-4fd5-a32a-18bf0a4a6e32", "tag": "24e2f8e1-d18e-4de5-8def-21249af05cd2"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:22.309124 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:41:22.309124 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:41:22.319300 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ed1f264a-bb27-41af-936d-332b641f3d82 req-2bc88820-89f8-4f69-8165-e30bbb6b696b service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:22.319844 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ed1f264a-bb27-41af-936d-332b641f3d82 req-2bc88820-89f8-4f69-8165-e30bbb6b696b service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:22.334093 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-ed1f264a-bb27-41af-936d-332b641f3d82 req-2bc88820-89f8-4f69-8165-e30bbb6b696b service nova] Creating event network-changed:24e2f8e1-d18e-4de5-8def-21249af05cd2 for instance 047748f3-80f4-4fd5-a32a-18bf0a4a6e32 on hv-cinder-81565 Oct 28 08:41:22.338752 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-ed1f264a-bb27-41af-936d-332b641f3d82 req-2bc88820-89f8-4f69-8165-e30bbb6b696b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048494 Oct 28 08:41:22.339605 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 150/300] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:41:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:41:22.481879 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-f8b8c8a2-e554-4a2b-b6fd-00cf97e1b8d7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:22.485350 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6c3bcf9e-5a28-4fc2-b6f4-1edd62d1edbb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:22.487868 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6c3bcf9e-5a28-4fc2-b6f4-1edd62d1edbb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:22.490476 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f8b8c8a2-e554-4a2b-b6fd-00cf97e1b8d7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.248971 Oct 28 08:41:22.491148 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 151/301] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:22 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:22.496557 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c3bcf9e-5a28-4fc2-b6f4-1edd62d1edbb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:22.497252 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c3bcf9e-5a28-4fc2-b6f4-1edd62d1edbb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:22.498225 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c3bcf9e-5a28-4fc2-b6f4-1edd62d1edbb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:22.498843 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c3bcf9e-5a28-4fc2-b6f4-1edd62d1edbb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:22.519260 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1d13a749-db9e-4570-8118-0f085d7b4beb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:22.520302 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1d13a749-db9e-4570-8118-0f085d7b4beb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:22.528030 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d13a749-db9e-4570-8118-0f085d7b4beb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:22.528711 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d13a749-db9e-4570-8118-0f085d7b4beb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:22.529583 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d13a749-db9e-4570-8118-0f085d7b4beb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:22.530103 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d13a749-db9e-4570-8118-0f085d7b4beb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:22.657151 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6c3bcf9e-5a28-4fc2-b6f4-1edd62d1edbb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 15064 microversion: 2.1 time: 0.177674 Oct 28 08:41:22.658195 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 151/302] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:22 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 15064 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:41:22.682358 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1d13a749-db9e-4570-8118-0f085d7b4beb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 17602 microversion: 2.20 time: 0.169629 Oct 28 08:41:22.684187 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 152/303] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:22 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 17602 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:41:22.777859 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9f04fe81-c665-4a18-86a9-0f3c0cb84725 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:22.779224 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9f04fe81-c665-4a18-86a9-0f3c0cb84725 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 047748f3-80f4-4fd5-a32a-18bf0a4a6e32] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:22.791385 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f04fe81-c665-4a18-86a9-0f3c0cb84725 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:22.792150 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f04fe81-c665-4a18-86a9-0f3c0cb84725 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:22.793240 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f04fe81-c665-4a18-86a9-0f3c0cb84725 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:22.793962 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f04fe81-c665-4a18-86a9-0f3c0cb84725 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:22.804914 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-085b675c-4f50-4e3a-b137-010ebe5a4c12 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:22.805722 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-085b675c-4f50-4e3a-b137-010ebe5a4c12 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 91e77c4e-c82e-4295-811a-8d992ea9209c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:22.812953 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-085b675c-4f50-4e3a-b137-010ebe5a4c12 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:22.813998 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-085b675c-4f50-4e3a-b137-010ebe5a4c12 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:22.814805 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-085b675c-4f50-4e3a-b137-010ebe5a4c12 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:22.815401 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-085b675c-4f50-4e3a-b137-010ebe5a4c12 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:23.057664 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-085b675c-4f50-4e3a-b137-010ebe5a4c12 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:23.065412 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-9f04fe81-c665-4a18-86a9-0f3c0cb84725 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:23.073508 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-085b675c-4f50-4e3a-b137-010ebe5a4c12 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c" status: 200 len: 1312 microversion: 2.1 time: 0.274384 Oct 28 08:41:23.074212 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 153/304] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:22 2021] GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c => generated 1312 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:23.082525 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9f04fe81-c665-4a18-86a9-0f3c0cb84725 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32" status: 200 len: 1317 microversion: 2.1 time: 0.305363 Oct 28 08:41:23.083252 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 152/305] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:22 2021] GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32 => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:23.512554 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4922de5b-9c9a-46ef-bef0-9a7bce78cfaa tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:23.513210 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4922de5b-9c9a-46ef-bef0-9a7bce78cfaa tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:23.520601 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4922de5b-9c9a-46ef-bef0-9a7bce78cfaa tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:23.521044 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4922de5b-9c9a-46ef-bef0-9a7bce78cfaa tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:23.521818 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4922de5b-9c9a-46ef-bef0-9a7bce78cfaa tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:23.522243 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4922de5b-9c9a-46ef-bef0-9a7bce78cfaa tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:23.673303 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b1c39430-e4f9-4ed8-a6b6-e6902bf9f692 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:23.675224 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b1c39430-e4f9-4ed8-a6b6-e6902bf9f692 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:23.681922 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1c39430-e4f9-4ed8-a6b6-e6902bf9f692 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:23.682364 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1c39430-e4f9-4ed8-a6b6-e6902bf9f692 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:23.683367 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1c39430-e4f9-4ed8-a6b6-e6902bf9f692 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:23.683797 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1c39430-e4f9-4ed8-a6b6-e6902bf9f692 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:23.709428 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-4922de5b-9c9a-46ef-bef0-9a7bce78cfaa tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:23.723400 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4922de5b-9c9a-46ef-bef0-9a7bce78cfaa tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.214219 Oct 28 08:41:23.724545 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 154/306] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:23 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:23.731842 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2f5ad444-f719-4aaa-9a07-00f5fbfd9f84 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:23.733847 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2f5ad444-f719-4aaa-9a07-00f5fbfd9f84 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:23.740249 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f5ad444-f719-4aaa-9a07-00f5fbfd9f84 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:23.740728 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f5ad444-f719-4aaa-9a07-00f5fbfd9f84 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:23.741614 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f5ad444-f719-4aaa-9a07-00f5fbfd9f84 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:23.742051 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f5ad444-f719-4aaa-9a07-00f5fbfd9f84 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:23.930334 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b1c39430-e4f9-4ed8-a6b6-e6902bf9f692 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 17055 microversion: 2.1 time: 0.263438 Oct 28 08:41:23.932020 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 153/307] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:23 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 17055 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:23.946877 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2f5ad444-f719-4aaa-9a07-00f5fbfd9f84 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 17602 microversion: 2.20 time: 0.220650 Oct 28 08:41:23.951084 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 155/308] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:23 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 17602 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:41:24.093043 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3ac1a5b7-da30-4629-b196-df35bc69521d tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:24.093930 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3ac1a5b7-da30-4629-b196-df35bc69521d tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 91e77c4e-c82e-4295-811a-8d992ea9209c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:24.102065 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-47724f28-9d35-4ed7-82ef-39362279a321 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:24.102930 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-47724f28-9d35-4ed7-82ef-39362279a321 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 047748f3-80f4-4fd5-a32a-18bf0a4a6e32] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:24.105599 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ac1a5b7-da30-4629-b196-df35bc69521d tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:24.106266 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ac1a5b7-da30-4629-b196-df35bc69521d tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:24.107628 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ac1a5b7-da30-4629-b196-df35bc69521d tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:24.108351 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ac1a5b7-da30-4629-b196-df35bc69521d tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:24.112416 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47724f28-9d35-4ed7-82ef-39362279a321 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:24.112855 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47724f28-9d35-4ed7-82ef-39362279a321 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:24.114095 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47724f28-9d35-4ed7-82ef-39362279a321 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:24.114579 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47724f28-9d35-4ed7-82ef-39362279a321 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:24.336443 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-3ac1a5b7-da30-4629-b196-df35bc69521d tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:24.347755 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3ac1a5b7-da30-4629-b196-df35bc69521d tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c" status: 200 len: 1312 microversion: 2.1 time: 0.260449 Oct 28 08:41:24.348751 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 154/309] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:24 2021] GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c => generated 1312 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:24.351819 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-47724f28-9d35-4ed7-82ef-39362279a321 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:24.361274 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-47724f28-9d35-4ed7-82ef-39362279a321 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32" status: 200 len: 1317 microversion: 2.1 time: 0.264062 Oct 28 08:41:24.362129 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 156/310] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:24 2021] GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:24.741889 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dde4572d-62e1-4660-9eed-44fd50e1e902 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:24.742554 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dde4572d-62e1-4660-9eed-44fd50e1e902 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:24.754165 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dde4572d-62e1-4660-9eed-44fd50e1e902 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:24.754996 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dde4572d-62e1-4660-9eed-44fd50e1e902 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:24.756381 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dde4572d-62e1-4660-9eed-44fd50e1e902 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:24.757403 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dde4572d-62e1-4660-9eed-44fd50e1e902 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:24.912958 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-dde4572d-62e1-4660-9eed-44fd50e1e902 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:24.931036 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dde4572d-62e1-4660-9eed-44fd50e1e902 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.191807 Oct 28 08:41:24.932977 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 155/311] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:24 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:24.949487 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-90f1d19e-75f5-4ac7-831f-b39858fb52e6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:24.950954 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-90f1d19e-75f5-4ac7-831f-b39858fb52e6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:24.959031 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-265b3868-2a85-4566-83d7-74ae08d41012 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:24.960354 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-265b3868-2a85-4566-83d7-74ae08d41012 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:24.966858 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-265b3868-2a85-4566-83d7-74ae08d41012 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:24.967687 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-265b3868-2a85-4566-83d7-74ae08d41012 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:24.967853 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90f1d19e-75f5-4ac7-831f-b39858fb52e6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:24.968071 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-265b3868-2a85-4566-83d7-74ae08d41012 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:24.968459 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90f1d19e-75f5-4ac7-831f-b39858fb52e6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:24.968704 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-265b3868-2a85-4566-83d7-74ae08d41012 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:24.969269 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90f1d19e-75f5-4ac7-831f-b39858fb52e6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:24.970254 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90f1d19e-75f5-4ac7-831f-b39858fb52e6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:25.104036 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-90f1d19e-75f5-4ac7-831f-b39858fb52e6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 17629 microversion: 2.1 time: 0.161058 Oct 28 08:41:25.109450 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 157/312] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:24 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 17629 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:25.130131 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3840279c-f483-4a2a-a627-499cace446ce tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:25.130732 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3840279c-f483-4a2a-a627-499cace446ce tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:25.139171 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3840279c-f483-4a2a-a627-499cace446ce tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:25.139845 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3840279c-f483-4a2a-a627-499cace446ce tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:25.140760 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3840279c-f483-4a2a-a627-499cace446ce tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:25.141939 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3840279c-f483-4a2a-a627-499cace446ce tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:25.152577 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-265b3868-2a85-4566-83d7-74ae08d41012 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 17849 microversion: 2.20 time: 0.197083 Oct 28 08:41:25.153302 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 156/313] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:24 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 17849 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:41:25.180210 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3840279c-f483-4a2a-a627-499cace446ce tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:41:25.284378 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3840279c-f483-4a2a-a627-499cace446ce tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "DELETE /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 204 len: 0 microversion: 2.1 time: 0.158452 Oct 28 08:41:25.284957 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 158/314] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Oct 28 08:41:25 2021] DELETE /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 08:41:25.293616 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-da65501d-dca9-46e8-b2fd-6b60a061f6c4 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:25.294436 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-da65501d-dca9-46e8-b2fd-6b60a061f6c4 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:25.301976 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da65501d-dca9-46e8-b2fd-6b60a061f6c4 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:25.302541 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da65501d-dca9-46e8-b2fd-6b60a061f6c4 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:25.303369 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da65501d-dca9-46e8-b2fd-6b60a061f6c4 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:25.303805 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da65501d-dca9-46e8-b2fd-6b60a061f6c4 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:25.366152 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5b726c97-f326-4b94-8fd2-855d0b978f52 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:25.366871 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5b726c97-f326-4b94-8fd2-855d0b978f52 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 91e77c4e-c82e-4295-811a-8d992ea9209c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:25.379144 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b726c97-f326-4b94-8fd2-855d0b978f52 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:25.379900 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b726c97-f326-4b94-8fd2-855d0b978f52 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:25.380805 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b726c97-f326-4b94-8fd2-855d0b978f52 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:25.381388 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b726c97-f326-4b94-8fd2-855d0b978f52 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:25.484395 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-da65501d-dca9-46e8-b2fd-6b60a061f6c4 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:25.494698 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-da65501d-dca9-46e8-b2fd-6b60a061f6c4 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1553 microversion: 2.1 time: 0.205016 Oct 28 08:41:25.495280 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 157/315] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:25 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1553 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:25.501356 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a55367c0-1bcc-447c-b50c-13cd41dbe098 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:25.502702 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a55367c0-1bcc-447c-b50c-13cd41dbe098 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 047748f3-80f4-4fd5-a32a-18bf0a4a6e32] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:25.509129 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a55367c0-1bcc-447c-b50c-13cd41dbe098 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:25.509567 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a55367c0-1bcc-447c-b50c-13cd41dbe098 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:25.510327 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a55367c0-1bcc-447c-b50c-13cd41dbe098 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:25.510777 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a55367c0-1bcc-447c-b50c-13cd41dbe098 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:25.559474 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-5b726c97-f326-4b94-8fd2-855d0b978f52 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:25.567407 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5b726c97-f326-4b94-8fd2-855d0b978f52 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c" status: 200 len: 1312 microversion: 2.1 time: 0.205255 Oct 28 08:41:25.567999 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 159/316] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:25 2021] GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c => generated 1312 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:25.658795 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-a55367c0-1bcc-447c-b50c-13cd41dbe098 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:25.666336 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a55367c0-1bcc-447c-b50c-13cd41dbe098 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32" status: 200 len: 1317 microversion: 2.1 time: 0.169194 Oct 28 08:41:25.666945 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 158/317] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:25 2021] GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:25.950846 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b2d8f293-ef7f-43dd-aa13-36b6aeae3799 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:25.951902 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b2d8f293-ef7f-43dd-aa13-36b6aeae3799 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:25.960023 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2d8f293-ef7f-43dd-aa13-36b6aeae3799 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:25.960335 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2d8f293-ef7f-43dd-aa13-36b6aeae3799 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:25.961116 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2d8f293-ef7f-43dd-aa13-36b6aeae3799 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:25.961538 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2d8f293-ef7f-43dd-aa13-36b6aeae3799 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:26.120845 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-221e8daa-f7cc-4376-ab06-0c536252a5a7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:26.122022 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-221e8daa-f7cc-4376-ab06-0c536252a5a7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:26.130205 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-221e8daa-f7cc-4376-ab06-0c536252a5a7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:26.130987 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-221e8daa-f7cc-4376-ab06-0c536252a5a7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:26.132394 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-221e8daa-f7cc-4376-ab06-0c536252a5a7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:26.132875 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-221e8daa-f7cc-4376-ab06-0c536252a5a7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:26.135488 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-b2d8f293-ef7f-43dd-aa13-36b6aeae3799 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:26.144559 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b2d8f293-ef7f-43dd-aa13-36b6aeae3799 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.198838 Oct 28 08:41:26.146562 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 160/318] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:25 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:26.164996 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-793703fd-5ca2-438f-8965-e3bc3a657858 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:26.166258 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-793703fd-5ca2-438f-8965-e3bc3a657858 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:26.174311 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-793703fd-5ca2-438f-8965-e3bc3a657858 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:26.174311 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-793703fd-5ca2-438f-8965-e3bc3a657858 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:26.175061 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-793703fd-5ca2-438f-8965-e3bc3a657858 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:26.175497 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-793703fd-5ca2-438f-8965-e3bc3a657858 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:26.428175 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-793703fd-5ca2-438f-8965-e3bc3a657858 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 19342 microversion: 2.20 time: 0.267453 Oct 28 08:41:26.428721 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 161/319] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:26 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 19342 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:41:26.435420 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-221e8daa-f7cc-4376-ab06-0c536252a5a7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 17629 microversion: 2.1 time: 0.320255 Oct 28 08:41:26.436207 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 159/320] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:26 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 17629 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:26.512643 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8121650a-4d12-4fab-a162-28564520f8b5 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:26.513322 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8121650a-4d12-4fab-a162-28564520f8b5 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:26.520377 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8121650a-4d12-4fab-a162-28564520f8b5 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:26.520817 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8121650a-4d12-4fab-a162-28564520f8b5 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:26.521582 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8121650a-4d12-4fab-a162-28564520f8b5 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:26.522007 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8121650a-4d12-4fab-a162-28564520f8b5 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:26.587021 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c68afab4-7c06-4c82-a69d-34c692236cdf tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:26.587710 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c68afab4-7c06-4c82-a69d-34c692236cdf tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 91e77c4e-c82e-4295-811a-8d992ea9209c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:26.595374 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c68afab4-7c06-4c82-a69d-34c692236cdf tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:26.595817 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c68afab4-7c06-4c82-a69d-34c692236cdf tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:26.596594 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c68afab4-7c06-4c82-a69d-34c692236cdf tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:26.597016 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c68afab4-7c06-4c82-a69d-34c692236cdf tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:26.695273 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-8121650a-4d12-4fab-a162-28564520f8b5 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:26.708435 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8121650a-4d12-4fab-a162-28564520f8b5 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1553 microversion: 2.1 time: 0.195392 Oct 28 08:41:26.709475 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 162/321] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:26 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1553 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:26.717657 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e1185163-d886-4464-acf7-183a0d941368 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:26.718262 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e1185163-d886-4464-acf7-183a0d941368 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 047748f3-80f4-4fd5-a32a-18bf0a4a6e32] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:26.725332 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1185163-d886-4464-acf7-183a0d941368 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:26.725774 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1185163-d886-4464-acf7-183a0d941368 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:26.727131 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1185163-d886-4464-acf7-183a0d941368 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:26.727131 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1185163-d886-4464-acf7-183a0d941368 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:26.784497 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c68afab4-7c06-4c82-a69d-34c692236cdf tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:26.792244 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c68afab4-7c06-4c82-a69d-34c692236cdf tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c" status: 200 len: 1312 microversion: 2.1 time: 0.209962 Oct 28 08:41:26.792810 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 160/322] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:26 2021] GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c => generated 1312 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:26.877003 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-e1185163-d886-4464-acf7-183a0d941368 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:26.884507 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e1185163-d886-4464-acf7-183a0d941368 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32" status: 200 len: 1317 microversion: 2.1 time: 0.173939 Oct 28 08:41:26.885076 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 163/323] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:26 2021] GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:27.161748 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-486e142b-1374-4763-818b-28f71c54bb60 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:27.162880 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-486e142b-1374-4763-818b-28f71c54bb60 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:27.170245 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-486e142b-1374-4763-818b-28f71c54bb60 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:27.170723 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-486e142b-1374-4763-818b-28f71c54bb60 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:27.171503 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-486e142b-1374-4763-818b-28f71c54bb60 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:27.171937 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-486e142b-1374-4763-818b-28f71c54bb60 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:27.312421 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-486e142b-1374-4763-818b-28f71c54bb60 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:27.321452 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-486e142b-1374-4763-818b-28f71c54bb60 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.164095 Oct 28 08:41:27.322009 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 161/324] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:27 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:27.442995 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f36e43a7-5b94-4e9d-8e5b-30143b7d194b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:27.443541 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f36e43a7-5b94-4e9d-8e5b-30143b7d194b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:27.447835 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0989ae48-724f-4484-8f79-b14add639db3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:27.448873 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0989ae48-724f-4484-8f79-b14add639db3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:27.450912 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f36e43a7-5b94-4e9d-8e5b-30143b7d194b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:27.451354 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f36e43a7-5b94-4e9d-8e5b-30143b7d194b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:27.452096 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f36e43a7-5b94-4e9d-8e5b-30143b7d194b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:27.452522 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f36e43a7-5b94-4e9d-8e5b-30143b7d194b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:27.456990 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0989ae48-724f-4484-8f79-b14add639db3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:27.457437 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0989ae48-724f-4484-8f79-b14add639db3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:27.458614 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0989ae48-724f-4484-8f79-b14add639db3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:27.459069 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0989ae48-724f-4484-8f79-b14add639db3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:27.690412 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f36e43a7-5b94-4e9d-8e5b-30143b7d194b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 20517 microversion: 2.20 time: 0.253159 Oct 28 08:41:27.691274 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 164/325] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:27 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 20517 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:41:27.713695 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0989ae48-724f-4484-8f79-b14add639db3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 19243 microversion: 2.1 time: 0.269423 Oct 28 08:41:27.714354 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 162/326] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:27 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 19243 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:41:27.726325 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8da1c0d5-de23-45c4-bf46-75dd293a8432 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:27.727055 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8da1c0d5-de23-45c4-bf46-75dd293a8432 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:27.734754 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8da1c0d5-de23-45c4-bf46-75dd293a8432 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:27.735769 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8da1c0d5-de23-45c4-bf46-75dd293a8432 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:27.736543 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8da1c0d5-de23-45c4-bf46-75dd293a8432 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:27.736967 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8da1c0d5-de23-45c4-bf46-75dd293a8432 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:27.817254 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4ea67610-0634-418a-a4ba-1fcbc0e1557f tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:27.818070 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4ea67610-0634-418a-a4ba-1fcbc0e1557f tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 91e77c4e-c82e-4295-811a-8d992ea9209c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:27.827163 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ea67610-0634-418a-a4ba-1fcbc0e1557f tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:27.827847 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ea67610-0634-418a-a4ba-1fcbc0e1557f tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:27.829060 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ea67610-0634-418a-a4ba-1fcbc0e1557f tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:27.829819 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ea67610-0634-418a-a4ba-1fcbc0e1557f tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:27.883891 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-8da1c0d5-de23-45c4-bf46-75dd293a8432 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:27.892401 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8da1c0d5-de23-45c4-bf46-75dd293a8432 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1553 microversion: 2.1 time: 0.170381 Oct 28 08:41:27.893083 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 165/327] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:27 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:27.908607 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a562af81-ae85-407e-9ab4-7419fb65a6e3 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:27.910075 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a562af81-ae85-407e-9ab4-7419fb65a6e3 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 047748f3-80f4-4fd5-a32a-18bf0a4a6e32] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:27.918610 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a562af81-ae85-407e-9ab4-7419fb65a6e3 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:27.919213 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a562af81-ae85-407e-9ab4-7419fb65a6e3 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:27.920061 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a562af81-ae85-407e-9ab4-7419fb65a6e3 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:27.920554 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a562af81-ae85-407e-9ab4-7419fb65a6e3 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:27.993584 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-4ea67610-0634-418a-a4ba-1fcbc0e1557f tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:28.006863 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4ea67610-0634-418a-a4ba-1fcbc0e1557f tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c" status: 200 len: 1312 microversion: 2.1 time: 0.193748 Oct 28 08:41:28.007454 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 163/328] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:27 2021] GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c => generated 1312 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:28.077587 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-a562af81-ae85-407e-9ab4-7419fb65a6e3 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:28.088299 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a562af81-ae85-407e-9ab4-7419fb65a6e3 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32" status: 200 len: 1317 microversion: 2.1 time: 0.187946 Oct 28 08:41:28.088873 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 166/329] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:27 2021] GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:28.344571 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-137749fc-7466-48d7-b57e-498706026fc8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:28.346560 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-137749fc-7466-48d7-b57e-498706026fc8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:28.356023 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-137749fc-7466-48d7-b57e-498706026fc8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:28.356474 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-137749fc-7466-48d7-b57e-498706026fc8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:28.357603 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-137749fc-7466-48d7-b57e-498706026fc8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:28.358249 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-137749fc-7466-48d7-b57e-498706026fc8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:28.558287 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-137749fc-7466-48d7-b57e-498706026fc8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:28.566805 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-137749fc-7466-48d7-b57e-498706026fc8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.228513 Oct 28 08:41:28.567259 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 164/330] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:28 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:28.646893 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-6ac71e99-1f0f-4ea3-bdc5-dd429a658098 req-efc150c0-1f17-4475-aaa8-b2c8449eb96c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e77c4e-c82e-4295-811a-8d992ea9209c", "name": "network-vif-plugged", "status": "completed", "tag": "5c920b6d-61e7-4b04-9084-e8c83a6b11c7"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:28.648661 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:41:28.648661 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:41:28.656239 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6ac71e99-1f0f-4ea3-bdc5-dd429a658098 req-efc150c0-1f17-4475-aaa8-b2c8449eb96c service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:28.656779 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6ac71e99-1f0f-4ea3-bdc5-dd429a658098 req-efc150c0-1f17-4475-aaa8-b2c8449eb96c service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:28.679702 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-6ac71e99-1f0f-4ea3-bdc5-dd429a658098 req-efc150c0-1f17-4475-aaa8-b2c8449eb96c service nova] Creating event network-vif-plugged:5c920b6d-61e7-4b04-9084-e8c83a6b11c7 for instance 91e77c4e-c82e-4295-811a-8d992ea9209c on hv-cinder-81565 Oct 28 08:41:28.688268 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-6ac71e99-1f0f-4ea3-bdc5-dd429a658098 req-efc150c0-1f17-4475-aaa8-b2c8449eb96c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044261 Oct 28 08:41:28.688675 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 167/331] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:41:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:41:28.704799 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bdd98e78-8a37-423e-ac3c-ebec34e57845 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:28.706213 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bdd98e78-8a37-423e-ac3c-ebec34e57845 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:28.713161 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdd98e78-8a37-423e-ac3c-ebec34e57845 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:28.713935 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdd98e78-8a37-423e-ac3c-ebec34e57845 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:28.714968 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdd98e78-8a37-423e-ac3c-ebec34e57845 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:28.715461 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdd98e78-8a37-423e-ac3c-ebec34e57845 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:28.730440 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eba6f887-e45f-46b0-9554-9c8ca1b161b4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:28.732343 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eba6f887-e45f-46b0-9554-9c8ca1b161b4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:28.740149 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eba6f887-e45f-46b0-9554-9c8ca1b161b4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:28.740729 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eba6f887-e45f-46b0-9554-9c8ca1b161b4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:28.741578 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eba6f887-e45f-46b0-9554-9c8ca1b161b4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:28.742091 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eba6f887-e45f-46b0-9554-9c8ca1b161b4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:28.854581 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eba6f887-e45f-46b0-9554-9c8ca1b161b4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 19774 microversion: 2.1 time: 0.130687 Oct 28 08:41:28.855682 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 168/332] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:28 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 19774 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:28.921474 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-299f4478-b636-485f-ae58-22a9ce951aa8 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:28.922194 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-299f4478-b636-485f-ae58-22a9ce951aa8 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:28.930779 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-299f4478-b636-485f-ae58-22a9ce951aa8 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:28.931415 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-299f4478-b636-485f-ae58-22a9ce951aa8 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:28.932534 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-299f4478-b636-485f-ae58-22a9ce951aa8 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:28.932969 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-299f4478-b636-485f-ae58-22a9ce951aa8 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:29.104418 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-299f4478-b636-485f-ae58-22a9ce951aa8 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:29.112629 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-299f4478-b636-485f-ae58-22a9ce951aa8 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1553 microversion: 2.1 time: 0.195111 Oct 28 08:41:29.113208 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 169/333] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:28 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1553 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:29.117682 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f4aa5c2d-82f5-4fbd-8cbe-e41b9b9f94fd tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:29.118304 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f4aa5c2d-82f5-4fbd-8cbe-e41b9b9f94fd tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 91e77c4e-c82e-4295-811a-8d992ea9209c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:29.125369 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4aa5c2d-82f5-4fbd-8cbe-e41b9b9f94fd tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:29.125995 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4aa5c2d-82f5-4fbd-8cbe-e41b9b9f94fd tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:29.126904 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4aa5c2d-82f5-4fbd-8cbe-e41b9b9f94fd tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:29.127324 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4aa5c2d-82f5-4fbd-8cbe-e41b9b9f94fd tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:29.263760 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-f4aa5c2d-82f5-4fbd-8cbe-e41b9b9f94fd tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:29.272688 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f4aa5c2d-82f5-4fbd-8cbe-e41b9b9f94fd tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c" status: 200 len: 1312 microversion: 2.1 time: 0.158407 Oct 28 08:41:29.273280 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 170/334] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:29 2021] GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:29.277951 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d2a2941d-ac70-4f85-9e92-c27bf1e2fd70 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:29.278576 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d2a2941d-ac70-4f85-9e92-c27bf1e2fd70 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 047748f3-80f4-4fd5-a32a-18bf0a4a6e32] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:29.285174 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2a2941d-ac70-4f85-9e92-c27bf1e2fd70 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:29.285610 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2a2941d-ac70-4f85-9e92-c27bf1e2fd70 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:29.286391 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2a2941d-ac70-4f85-9e92-c27bf1e2fd70 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:29.286851 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2a2941d-ac70-4f85-9e92-c27bf1e2fd70 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:29.426191 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-d2a2941d-ac70-4f85-9e92-c27bf1e2fd70 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:29.433643 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d2a2941d-ac70-4f85-9e92-c27bf1e2fd70 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32" status: 200 len: 1317 microversion: 2.1 time: 0.159407 Oct 28 08:41:29.434202 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 171/335] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:29 2021] GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:29.441769 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bdd98e78-8a37-423e-ac3c-ebec34e57845 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 22379 microversion: 2.20 time: 0.741783 Oct 28 08:41:29.442799 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 165/336] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:28 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 22379 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:41:29.584774 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8b4e62f0-270a-4214-82f9-ba49ae8b9e16 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:29.585375 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8b4e62f0-270a-4214-82f9-ba49ae8b9e16 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:29.592147 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b4e62f0-270a-4214-82f9-ba49ae8b9e16 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:29.592597 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b4e62f0-270a-4214-82f9-ba49ae8b9e16 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:29.593366 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b4e62f0-270a-4214-82f9-ba49ae8b9e16 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:29.593792 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b4e62f0-270a-4214-82f9-ba49ae8b9e16 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:29.860632 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-8b4e62f0-270a-4214-82f9-ba49ae8b9e16 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:29.870221 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-04824687-3e56-42f4-9b8a-bc9101b20726 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:29.872200 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-04824687-3e56-42f4-9b8a-bc9101b20726 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:29.885032 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04824687-3e56-42f4-9b8a-bc9101b20726 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:29.885726 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04824687-3e56-42f4-9b8a-bc9101b20726 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:29.885846 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8b4e62f0-270a-4214-82f9-ba49ae8b9e16 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.303750 Oct 28 08:41:29.886779 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04824687-3e56-42f4-9b8a-bc9101b20726 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:29.887421 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04824687-3e56-42f4-9b8a-bc9101b20726 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:29.887542 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 172/337] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:29 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:29.999808 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-04824687-3e56-42f4-9b8a-bc9101b20726 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 21617 microversion: 2.1 time: 0.135594 Oct 28 08:41:30.000452 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 166/338] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:29 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 21617 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:30.130573 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e3d89fc0-22f6-445a-b3d9-57f827e286f8 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:30.131355 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e3d89fc0-22f6-445a-b3d9-57f827e286f8 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:30.139464 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3d89fc0-22f6-445a-b3d9-57f827e286f8 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:30.139767 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3d89fc0-22f6-445a-b3d9-57f827e286f8 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:30.140571 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3d89fc0-22f6-445a-b3d9-57f827e286f8 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:30.141005 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3d89fc0-22f6-445a-b3d9-57f827e286f8 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:30.290899 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7c171f99-f9e5-4735-9cfa-cc954244f375 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:30.291596 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7c171f99-f9e5-4735-9cfa-cc954244f375 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 91e77c4e-c82e-4295-811a-8d992ea9209c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:30.298892 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c171f99-f9e5-4735-9cfa-cc954244f375 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:30.299329 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c171f99-f9e5-4735-9cfa-cc954244f375 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:30.300101 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c171f99-f9e5-4735-9cfa-cc954244f375 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:30.300519 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c171f99-f9e5-4735-9cfa-cc954244f375 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:30.381457 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-e3d89fc0-22f6-445a-b3d9-57f827e286f8 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:30.391067 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e3d89fc0-22f6-445a-b3d9-57f827e286f8 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1553 microversion: 2.1 time: 0.265096 Oct 28 08:41:30.391907 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 173/339] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:30 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1553 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:30.452847 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ab718460-a4ad-482d-8867-071ae6179f67 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:30.453590 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ab718460-a4ad-482d-8867-071ae6179f67 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 047748f3-80f4-4fd5-a32a-18bf0a4a6e32] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:30.459707 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab718460-a4ad-482d-8867-071ae6179f67 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:30.460147 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab718460-a4ad-482d-8867-071ae6179f67 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:30.460918 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab718460-a4ad-482d-8867-071ae6179f67 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:30.461345 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab718460-a4ad-482d-8867-071ae6179f67 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:30.742205 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-7c171f99-f9e5-4735-9cfa-cc954244f375 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:30.749519 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7c171f99-f9e5-4735-9cfa-cc954244f375 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c" status: 200 len: 1312 microversion: 2.1 time: 0.462789 Oct 28 08:41:30.750284 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 167/340] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:30 2021] GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c => generated 1312 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:30.755299 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-71d26914-7bb4-41b8-bb93-c74579aae149 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:30.756213 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-71d26914-7bb4-41b8-bb93-c74579aae149 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:30.761885 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71d26914-7bb4-41b8-bb93-c74579aae149 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:30.762635 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71d26914-7bb4-41b8-bb93-c74579aae149 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:30.763434 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71d26914-7bb4-41b8-bb93-c74579aae149 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:30.763895 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71d26914-7bb4-41b8-bb93-c74579aae149 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:30.800785 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-ab718460-a4ad-482d-8867-071ae6179f67 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:30.807828 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ab718460-a4ad-482d-8867-071ae6179f67 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32" status: 200 len: 1317 microversion: 2.1 time: 0.358698 Oct 28 08:41:30.808385 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 174/341] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:30 2021] GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32 => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:30.812521 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-d383899c-923f-49e4-88fa-aab5d7e4fce1 req-93ba7e42-8ce4-4a7b-8890-7f5718d2495e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef6e834-e02d-41aa-8962-4caf135b9d54", "name": "network-vif-deleted", "tag": "9ea8a9e5-c360-4361-8ee7-43bd5674b3d6"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:30.814176 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:41:30.814176 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:41:30.820722 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d383899c-923f-49e4-88fa-aab5d7e4fce1 req-93ba7e42-8ce4-4a7b-8890-7f5718d2495e service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:30.821144 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d383899c-923f-49e4-88fa-aab5d7e4fce1 req-93ba7e42-8ce4-4a7b-8890-7f5718d2495e service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:30.832481 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-d383899c-923f-49e4-88fa-aab5d7e4fce1 req-93ba7e42-8ce4-4a7b-8890-7f5718d2495e service nova] Creating event network-vif-deleted:9ea8a9e5-c360-4361-8ee7-43bd5674b3d6 for instance 2ef6e834-e02d-41aa-8962-4caf135b9d54 on hv-cinder-81565 Oct 28 08:41:30.837198 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-d383899c-923f-49e4-88fa-aab5d7e4fce1 req-93ba7e42-8ce4-4a7b-8890-7f5718d2495e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027757 Oct 28 08:41:30.837775 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 175/342] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:41:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:41:30.852617 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-71d26914-7bb4-41b8-bb93-c74579aae149 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 23220 microversion: 2.20 time: 0.100657 Oct 28 08:41:30.853243 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 168/343] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:30 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 23220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:41:30.905322 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-183af65c-2a61-40a5-a669-b200ebdaf56c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:30.906014 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-183af65c-2a61-40a5-a669-b200ebdaf56c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:30.912650 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-183af65c-2a61-40a5-a669-b200ebdaf56c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:30.912941 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-183af65c-2a61-40a5-a669-b200ebdaf56c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:30.913712 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-183af65c-2a61-40a5-a669-b200ebdaf56c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:30.914142 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-183af65c-2a61-40a5-a669-b200ebdaf56c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:31.016408 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-943c6fc2-35ad-4f03-abe8-d6c5fd6381bf tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:31.018052 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-943c6fc2-35ad-4f03-abe8-d6c5fd6381bf tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:31.024591 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-943c6fc2-35ad-4f03-abe8-d6c5fd6381bf tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:31.025024 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-943c6fc2-35ad-4f03-abe8-d6c5fd6381bf tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:31.025796 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-943c6fc2-35ad-4f03-abe8-d6c5fd6381bf tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:31.026218 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-943c6fc2-35ad-4f03-abe8-d6c5fd6381bf tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:31.040166 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-183af65c-2a61-40a5-a669-b200ebdaf56c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:31.047523 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-183af65c-2a61-40a5-a669-b200ebdaf56c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.146099 Oct 28 08:41:31.048617 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 176/344] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:30 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:31.211907 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-943c6fc2-35ad-4f03-abe8-d6c5fd6381bf tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 22841 microversion: 2.1 time: 0.199344 Oct 28 08:41:31.212697 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 169/345] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:31 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 22841 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:31.409874 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-805caf66-5330-4fe1-a427-24fb884d02f0 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:31.410470 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-805caf66-5330-4fe1-a427-24fb884d02f0 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:31.416988 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-805caf66-5330-4fe1-a427-24fb884d02f0 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:31.417377 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-805caf66-5330-4fe1-a427-24fb884d02f0 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:31.418160 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-805caf66-5330-4fe1-a427-24fb884d02f0 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:31.418615 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-805caf66-5330-4fe1-a427-24fb884d02f0 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:31.485597 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-805caf66-5330-4fe1-a427-24fb884d02f0 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e000da3af24420a5d27011dc2fb95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1ab98d27254ae9b953182c6f2d1fc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:31.494143 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-805caf66-5330-4fe1-a427-24fb884d02f0 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 200 len: 1346 microversion: 2.1 time: 0.088471 Oct 28 08:41:31.494755 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 177/346] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:31 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 1346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:31.767857 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0abf50a1-c351-4a0a-b2a4-fae40c9b092a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:31.768468 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0abf50a1-c351-4a0a-b2a4-fae40c9b092a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 91e77c4e-c82e-4295-811a-8d992ea9209c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:31.775512 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0abf50a1-c351-4a0a-b2a4-fae40c9b092a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:31.776016 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0abf50a1-c351-4a0a-b2a4-fae40c9b092a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:31.776783 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0abf50a1-c351-4a0a-b2a4-fae40c9b092a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:31.777212 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0abf50a1-c351-4a0a-b2a4-fae40c9b092a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:31.823929 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-39c221cd-4380-4ba6-85b0-1e1ccbad82c8 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:31.824697 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-39c221cd-4380-4ba6-85b0-1e1ccbad82c8 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 047748f3-80f4-4fd5-a32a-18bf0a4a6e32] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:31.831102 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39c221cd-4380-4ba6-85b0-1e1ccbad82c8 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:31.831555 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39c221cd-4380-4ba6-85b0-1e1ccbad82c8 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:31.832312 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39c221cd-4380-4ba6-85b0-1e1ccbad82c8 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:31.832737 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39c221cd-4380-4ba6-85b0-1e1ccbad82c8 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:31.937352 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-0abf50a1-c351-4a0a-b2a4-fae40c9b092a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:31.946586 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0abf50a1-c351-4a0a-b2a4-fae40c9b092a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c" status: 200 len: 1496 microversion: 2.1 time: 0.183681 Oct 28 08:41:31.947173 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 170/347] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:31 2021] GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c => generated 1496 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:31.958664 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-14a4074b-f9ed-4756-aaa5-d61e305fda59 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:31.958664 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-14a4074b-f9ed-4756-aaa5-d61e305fda59 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:31.961655 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14a4074b-f9ed-4756-aaa5-d61e305fda59 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:31.961655 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14a4074b-f9ed-4756-aaa5-d61e305fda59 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:31.962218 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14a4074b-f9ed-4756-aaa5-d61e305fda59 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:31.962612 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14a4074b-f9ed-4756-aaa5-d61e305fda59 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:31.995045 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-39c221cd-4380-4ba6-85b0-1e1ccbad82c8 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:32.005458 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-39c221cd-4380-4ba6-85b0-1e1ccbad82c8 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32" status: 200 len: 1317 microversion: 2.1 time: 0.185122 Oct 28 08:41:32.006229 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 178/348] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:31 2021] GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:32.066110 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-aacb664b-ed47-4103-901a-e67c42396820 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:32.066973 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-aacb664b-ed47-4103-901a-e67c42396820 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:32.074329 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aacb664b-ed47-4103-901a-e67c42396820 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:32.074943 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aacb664b-ed47-4103-901a-e67c42396820 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:32.075749 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aacb664b-ed47-4103-901a-e67c42396820 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:32.076178 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aacb664b-ed47-4103-901a-e67c42396820 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:32.092186 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-14a4074b-f9ed-4756-aaa5-d61e305fda59 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 23789 microversion: 2.20 time: 0.143705 Oct 28 08:41:32.100444 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 171/349] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:31 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 23789 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:41:32.226784 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-171ace43-c38b-411a-aa8a-5327a66372d1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:32.228114 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-171ace43-c38b-411a-aa8a-5327a66372d1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:32.262814 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-171ace43-c38b-411a-aa8a-5327a66372d1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:32.263633 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-171ace43-c38b-411a-aa8a-5327a66372d1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:32.265812 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-171ace43-c38b-411a-aa8a-5327a66372d1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:32.267225 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-171ace43-c38b-411a-aa8a-5327a66372d1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:32.425580 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-171ace43-c38b-411a-aa8a-5327a66372d1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 23554 microversion: 2.1 time: 0.203621 Oct 28 08:41:32.426489 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 172/350] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:32 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 23554 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:32.456228 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-aacb664b-ed47-4103-901a-e67c42396820 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:32.487492 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-aacb664b-ed47-4103-901a-e67c42396820 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.419958 Oct 28 08:41:32.488814 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 179/351] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:32 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:32.516473 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7be9a7ad-8b80-437a-80a6-c70f9b911d44 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:32.518095 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7be9a7ad-8b80-437a-80a6-c70f9b911d44 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:32.533130 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7be9a7ad-8b80-437a-80a6-c70f9b911d44 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:32.534455 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7be9a7ad-8b80-437a-80a6-c70f9b911d44 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:32.536168 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7be9a7ad-8b80-437a-80a6-c70f9b911d44 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:32.537220 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7be9a7ad-8b80-437a-80a6-c70f9b911d44 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:32.557234 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-99dc999f-6e78-40be-be35-bbdad329c049 req-fed94e0d-63bf-4bb2-adcc-e984c42816ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "047748f3-80f4-4fd5-a32a-18bf0a4a6e32", "name": "network-vif-plugged", "status": "completed", "tag": "24e2f8e1-d18e-4de5-8def-21249af05cd2"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:32.560422 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-7be9a7ad-8b80-437a-80a6-c70f9b911d44 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] HTTP exception thrown: Instance 2ef6e834-e02d-41aa-8962-4caf135b9d54 could not be found. Oct 28 08:41:32.560892 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:41:32.560892 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:41:32.561203 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7be9a7ad-8b80-437a-80a6-c70f9b911d44 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Returning 404 to user: Instance 2ef6e834-e02d-41aa-8962-4caf135b9d54 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:41:32.562301 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7be9a7ad-8b80-437a-80a6-c70f9b911d44 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 404 len: 111 microversion: 2.1 time: 0.053841 Oct 28 08:41:32.565078 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 173/352] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:32 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:41:32.573810 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-99dc999f-6e78-40be-be35-bbdad329c049 req-fed94e0d-63bf-4bb2-adcc-e984c42816ff service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:32.574602 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-99dc999f-6e78-40be-be35-bbdad329c049 req-fed94e0d-63bf-4bb2-adcc-e984c42816ff service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:32.596607 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-99dc999f-6e78-40be-be35-bbdad329c049 req-fed94e0d-63bf-4bb2-adcc-e984c42816ff service nova] Creating event network-vif-plugged:24e2f8e1-d18e-4de5-8def-21249af05cd2 for instance 047748f3-80f4-4fd5-a32a-18bf0a4a6e32 on hv-cinder-81565 Oct 28 08:41:32.606985 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-99dc999f-6e78-40be-be35-bbdad329c049 req-fed94e0d-63bf-4bb2-adcc-e984c42816ff service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056444 Oct 28 08:41:32.608067 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 180/353] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:41:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:41:32.766694 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-59606435-030c-4d0a-845d-bcab383c8c20 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:32.767761 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-59606435-030c-4d0a-845d-bcab383c8c20 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 91e77c4e-c82e-4295-811a-8d992ea9209c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:32.780449 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59606435-030c-4d0a-845d-bcab383c8c20 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:32.781278 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59606435-030c-4d0a-845d-bcab383c8c20 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:32.783599 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59606435-030c-4d0a-845d-bcab383c8c20 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:32.783599 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59606435-030c-4d0a-845d-bcab383c8c20 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:32.790657 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-953903d4-0a30-480f-8f8d-9e69bd34682e tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:32.791689 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-953903d4-0a30-480f-8f8d-9e69bd34682e tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:32.798397 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-953903d4-0a30-480f-8f8d-9e69bd34682e tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:32.799131 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-953903d4-0a30-480f-8f8d-9e69bd34682e tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:32.800321 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-953903d4-0a30-480f-8f8d-9e69bd34682e tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:32.800758 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-953903d4-0a30-480f-8f8d-9e69bd34682e tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:32.814616 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-953903d4-0a30-480f-8f8d-9e69bd34682e tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] HTTP exception thrown: Instance 2ef6e834-e02d-41aa-8962-4caf135b9d54 could not be found. Oct 28 08:41:32.815687 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-953903d4-0a30-480f-8f8d-9e69bd34682e tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Returning 404 to user: Instance 2ef6e834-e02d-41aa-8962-4caf135b9d54 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:41:32.816751 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-953903d4-0a30-480f-8f8d-9e69bd34682e tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030894 Oct 28 08:41:32.818028 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 181/354] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Oct 28 08:41:32 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:41:32.823517 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-59606435-030c-4d0a-845d-bcab383c8c20 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 91e77c4e-c82e-4295-811a-8d992ea9209c] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:41:32.950646 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-59606435-030c-4d0a-845d-bcab383c8c20 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "DELETE /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c" status: 204 len: 0 microversion: 2.1 time: 0.188194 Oct 28 08:41:32.951226 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 174/355] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Oct 28 08:41:32 2021] DELETE /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:41:32.960973 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bf939962-bc87-4b10-902a-ece96eed0ff1 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:32.961889 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bf939962-bc87-4b10-902a-ece96eed0ff1 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 91e77c4e-c82e-4295-811a-8d992ea9209c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:32.970715 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf939962-bc87-4b10-902a-ece96eed0ff1 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:32.970715 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf939962-bc87-4b10-902a-ece96eed0ff1 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:32.971389 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf939962-bc87-4b10-902a-ece96eed0ff1 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:32.971979 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf939962-bc87-4b10-902a-ece96eed0ff1 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:33.026934 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7d8a8120-c3e5-4b42-ae0a-cba3af18a75f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:33.026934 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7d8a8120-c3e5-4b42-ae0a-cba3af18a75f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 047748f3-80f4-4fd5-a32a-18bf0a4a6e32] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:33.031794 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d8a8120-c3e5-4b42-ae0a-cba3af18a75f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:33.032324 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d8a8120-c3e5-4b42-ae0a-cba3af18a75f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:33.033198 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d8a8120-c3e5-4b42-ae0a-cba3af18a75f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:33.033884 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d8a8120-c3e5-4b42-ae0a-cba3af18a75f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:33.205330 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-bf939962-bc87-4b10-902a-ece96eed0ff1 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:33.212765 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bf939962-bc87-4b10-902a-ece96eed0ff1 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c" status: 200 len: 1502 microversion: 2.1 time: 0.256111 Oct 28 08:41:33.213481 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 182/356] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:32 2021] GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c => generated 1502 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:33.218443 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-da095239-7720-485a-b9c9-e2ace975d7bc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:33.218969 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-da095239-7720-485a-b9c9-e2ace975d7bc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:33.232076 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da095239-7720-485a-b9c9-e2ace975d7bc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:33.232609 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da095239-7720-485a-b9c9-e2ace975d7bc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:33.233442 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da095239-7720-485a-b9c9-e2ace975d7bc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:33.233931 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da095239-7720-485a-b9c9-e2ace975d7bc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:33.250239 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-7d8a8120-c3e5-4b42-ae0a-cba3af18a75f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:33.265472 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7d8a8120-c3e5-4b42-ae0a-cba3af18a75f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32" status: 200 len: 1317 microversion: 2.1 time: 0.245635 Oct 28 08:41:33.267834 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 175/357] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:33 2021] GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32 => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:33.362826 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-da095239-7720-485a-b9c9-e2ace975d7bc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 24773 microversion: 2.20 time: 0.148075 Oct 28 08:41:33.363474 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 183/358] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:33 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 24773 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:41:33.439238 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-54ed02e2-a6fb-4e04-b03c-8feb862ff5c2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:33.444845 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-54ed02e2-a6fb-4e04-b03c-8feb862ff5c2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:33.451967 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54ed02e2-a6fb-4e04-b03c-8feb862ff5c2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:33.452407 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54ed02e2-a6fb-4e04-b03c-8feb862ff5c2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:33.453181 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54ed02e2-a6fb-4e04-b03c-8feb862ff5c2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:33.454120 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54ed02e2-a6fb-4e04-b03c-8feb862ff5c2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:33.513981 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a83b2571-9ce4-436d-9f9c-61f76197569a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:33.514699 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a83b2571-9ce4-436d-9f9c-61f76197569a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:33.522280 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a83b2571-9ce4-436d-9f9c-61f76197569a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:33.522747 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a83b2571-9ce4-436d-9f9c-61f76197569a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:33.523510 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a83b2571-9ce4-436d-9f9c-61f76197569a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:33.523937 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a83b2571-9ce4-436d-9f9c-61f76197569a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:33.596346 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-54ed02e2-a6fb-4e04-b03c-8feb862ff5c2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 24162 microversion: 2.1 time: 0.162262 Oct 28 08:41:33.596990 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 176/359] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:33 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 24162 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:33.667958 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-a83b2571-9ce4-436d-9f9c-61f76197569a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:33.675709 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a83b2571-9ce4-436d-9f9c-61f76197569a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.165854 Oct 28 08:41:33.676282 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 184/360] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:33 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:34.061411 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-485c6411-3b28-459d-832c-64aa2c858973 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:34.062000 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-485c6411-3b28-459d-832c-64aa2c858973 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:34.069708 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-485c6411-3b28-459d-832c-64aa2c858973 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:34.070277 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-485c6411-3b28-459d-832c-64aa2c858973 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:34.070970 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-485c6411-3b28-459d-832c-64aa2c858973 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:34.071404 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-485c6411-3b28-459d-832c-64aa2c858973 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:34.087981 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-485c6411-3b28-459d-832c-64aa2c858973 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] HTTP exception thrown: Instance 2ef6e834-e02d-41aa-8962-4caf135b9d54 could not be found. Oct 28 08:41:34.088577 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-485c6411-3b28-459d-832c-64aa2c858973 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Returning 404 to user: Instance 2ef6e834-e02d-41aa-8962-4caf135b9d54 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:41:34.089401 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-485c6411-3b28-459d-832c-64aa2c858973 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "DELETE /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 404 len: 111 microversion: 2.1 time: 0.032068 Oct 28 08:41:34.089955 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 177/361] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Oct 28 08:41:34 2021] DELETE /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:41:34.099061 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-da5c235f-aed1-428b-b8de-cc8bd9db3c76 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:34.099534 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-da5c235f-aed1-428b-b8de-cc8bd9db3c76 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] [instance: 2ef6e834-e02d-41aa-8962-4caf135b9d54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:34.107315 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da5c235f-aed1-428b-b8de-cc8bd9db3c76 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:34.107315 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da5c235f-aed1-428b-b8de-cc8bd9db3c76 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:34.108012 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da5c235f-aed1-428b-b8de-cc8bd9db3c76 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:34.108431 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da5c235f-aed1-428b-b8de-cc8bd9db3c76 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:34.124558 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-da5c235f-aed1-428b-b8de-cc8bd9db3c76 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] HTTP exception thrown: Instance 2ef6e834-e02d-41aa-8962-4caf135b9d54 could not be found. Oct 28 08:41:34.125217 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-da5c235f-aed1-428b-b8de-cc8bd9db3c76 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] Returning 404 to user: Instance 2ef6e834-e02d-41aa-8962-4caf135b9d54 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:41:34.132709 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-da5c235f-aed1-428b-b8de-cc8bd9db3c76 tempest-DeleteServersTestJSON-420956754 tempest-DeleteServersTestJSON-420956754-project] 10.222.0.76 "GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54" status: 404 len: 111 microversion: 2.1 time: 0.038312 Oct 28 08:41:34.133638 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 185/362] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:34 2021] GET /compute/v2.1/servers/2ef6e834-e02d-41aa-8962-4caf135b9d54 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:41:34.231451 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9aa52b70-971b-4570-baa3-bbc93c1d46cc tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:34.232250 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9aa52b70-971b-4570-baa3-bbc93c1d46cc tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 91e77c4e-c82e-4295-811a-8d992ea9209c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:34.239996 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9aa52b70-971b-4570-baa3-bbc93c1d46cc tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:34.240448 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9aa52b70-971b-4570-baa3-bbc93c1d46cc tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:34.241470 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9aa52b70-971b-4570-baa3-bbc93c1d46cc tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:34.241909 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9aa52b70-971b-4570-baa3-bbc93c1d46cc tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:34.284577 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2762f33f-73ca-44cf-882b-478775d90984 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:34.286062 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2762f33f-73ca-44cf-882b-478775d90984 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 047748f3-80f4-4fd5-a32a-18bf0a4a6e32] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:34.292393 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2762f33f-73ca-44cf-882b-478775d90984 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:34.293137 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2762f33f-73ca-44cf-882b-478775d90984 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:34.294021 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2762f33f-73ca-44cf-882b-478775d90984 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:34.294681 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2762f33f-73ca-44cf-882b-478775d90984 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:34.526459 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-9aa52b70-971b-4570-baa3-bbc93c1d46cc tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:34.555596 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9aa52b70-971b-4570-baa3-bbc93c1d46cc tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c" status: 200 len: 1502 microversion: 2.1 time: 0.327712 Oct 28 08:41:34.557384 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 178/363] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:34 2021] GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c => generated 1502 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:34.568145 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6ddfcbbe-9e0c-4c2a-a1f4-4a643084f3fc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:34.570404 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6ddfcbbe-9e0c-4c2a-a1f4-4a643084f3fc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:34.580567 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-2762f33f-73ca-44cf-882b-478775d90984 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:34.589694 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ddfcbbe-9e0c-4c2a-a1f4-4a643084f3fc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:34.591105 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ddfcbbe-9e0c-4c2a-a1f4-4a643084f3fc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:34.592684 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ddfcbbe-9e0c-4c2a-a1f4-4a643084f3fc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:34.593694 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ddfcbbe-9e0c-4c2a-a1f4-4a643084f3fc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:34.595045 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2762f33f-73ca-44cf-882b-478775d90984 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32" status: 200 len: 1317 microversion: 2.1 time: 0.313200 Oct 28 08:41:34.596109 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 186/364] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:34 2021] GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32 => generated 1317 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:34.612075 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a325bc66-dac6-400a-9a8b-0ffcb7be9467 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:34.613518 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a325bc66-dac6-400a-9a8b-0ffcb7be9467 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:34.622712 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a325bc66-dac6-400a-9a8b-0ffcb7be9467 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:34.623004 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a325bc66-dac6-400a-9a8b-0ffcb7be9467 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:34.623983 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a325bc66-dac6-400a-9a8b-0ffcb7be9467 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:34.624618 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a325bc66-dac6-400a-9a8b-0ffcb7be9467 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:34.749586 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a325bc66-dac6-400a-9a8b-0ffcb7be9467 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 24884 microversion: 2.1 time: 0.145328 Oct 28 08:41:34.750228 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 187/365] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:34 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 24884 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:34.758281 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-68ebc502-702f-4d9a-a02e-4024431cc1d4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:34.759009 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-68ebc502-702f-4d9a-a02e-4024431cc1d4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:34.768965 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-68ebc502-702f-4d9a-a02e-4024431cc1d4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:34.769407 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-68ebc502-702f-4d9a-a02e-4024431cc1d4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:34.770196 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-68ebc502-702f-4d9a-a02e-4024431cc1d4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:34.770661 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-68ebc502-702f-4d9a-a02e-4024431cc1d4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:34.774841 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6ddfcbbe-9e0c-4c2a-a1f4-4a643084f3fc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 25464 microversion: 2.20 time: 0.214630 Oct 28 08:41:34.779342 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 179/366] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:34 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 25464 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:41:34.978180 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-68ebc502-702f-4d9a-a02e-4024431cc1d4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:34.987345 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-68ebc502-702f-4d9a-a02e-4024431cc1d4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.233921 Oct 28 08:41:34.996847 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 188/367] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:34 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:35.575406 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bf7322bd-1fad-4b4e-a495-c50e832b7c1a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:35.576961 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bf7322bd-1fad-4b4e-a495-c50e832b7c1a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 91e77c4e-c82e-4295-811a-8d992ea9209c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:35.585358 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf7322bd-1fad-4b4e-a495-c50e832b7c1a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:35.586074 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf7322bd-1fad-4b4e-a495-c50e832b7c1a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:35.587155 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf7322bd-1fad-4b4e-a495-c50e832b7c1a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:35.587796 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf7322bd-1fad-4b4e-a495-c50e832b7c1a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:35.631386 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-223a5faf-c8d0-46eb-9ac6-581c9a66c22f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:35.632024 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-223a5faf-c8d0-46eb-9ac6-581c9a66c22f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 047748f3-80f4-4fd5-a32a-18bf0a4a6e32] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:35.643824 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-223a5faf-c8d0-46eb-9ac6-581c9a66c22f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:35.644729 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-223a5faf-c8d0-46eb-9ac6-581c9a66c22f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:35.646045 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-223a5faf-c8d0-46eb-9ac6-581c9a66c22f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:35.647145 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-223a5faf-c8d0-46eb-9ac6-581c9a66c22f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:35.947749 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-bf7322bd-1fad-4b4e-a495-c50e832b7c1a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:35.957688 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bf7322bd-1fad-4b4e-a495-c50e832b7c1a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c" status: 200 len: 1502 microversion: 2.1 time: 0.387300 Oct 28 08:41:35.964827 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 180/368] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:35 2021] GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c => generated 1502 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:35.977907 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a3309494-1be0-43c7-9016-dd3fa8a775e0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:35.978852 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-223a5faf-c8d0-46eb-9ac6-581c9a66c22f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:35.979830 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a3309494-1be0-43c7-9016-dd3fa8a775e0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:35.986682 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a3309494-1be0-43c7-9016-dd3fa8a775e0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:35.987645 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a3309494-1be0-43c7-9016-dd3fa8a775e0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:35.988457 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-223a5faf-c8d0-46eb-9ac6-581c9a66c22f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32" status: 200 len: 1507 microversion: 2.1 time: 0.363295 Oct 28 08:41:35.989376 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 189/369] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:35 2021] GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32 => generated 1507 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:35.989530 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a3309494-1be0-43c7-9016-dd3fa8a775e0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:35.990020 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a3309494-1be0-43c7-9016-dd3fa8a775e0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:36.003244 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a53a81fb-027c-48a7-9dc4-bb6d481f8ab1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:36.004211 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a53a81fb-027c-48a7-9dc4-bb6d481f8ab1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:36.020139 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a53a81fb-027c-48a7-9dc4-bb6d481f8ab1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:36.020854 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a53a81fb-027c-48a7-9dc4-bb6d481f8ab1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:36.023270 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a53a81fb-027c-48a7-9dc4-bb6d481f8ab1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:36.023945 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a53a81fb-027c-48a7-9dc4-bb6d481f8ab1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:36.112087 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a3309494-1be0-43c7-9016-dd3fa8a775e0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 25717 microversion: 2.1 time: 0.145863 Oct 28 08:41:36.115903 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 181/370] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:35 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 25717 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:36.119899 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5ba658af-c1ee-45bf-8369-7c3fc1baf9b2 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:36.123252 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5ba658af-c1ee-45bf-8369-7c3fc1baf9b2 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:36.133175 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ba658af-c1ee-45bf-8369-7c3fc1baf9b2 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:36.133655 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ba658af-c1ee-45bf-8369-7c3fc1baf9b2 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:36.134442 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ba658af-c1ee-45bf-8369-7c3fc1baf9b2 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:36.134915 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ba658af-c1ee-45bf-8369-7c3fc1baf9b2 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:36.149853 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a53a81fb-027c-48a7-9dc4-bb6d481f8ab1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 26236 microversion: 2.20 time: 0.158860 Oct 28 08:41:36.150565 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 190/371] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:35 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 26236 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:41:36.161220 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-307f4b0e-3142-4d9e-ae13-eb88ec1242ca tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2cb1082-dfa1-45d6-aa6c-cb4c98524734"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:36.162415 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-307f4b0e-3142-4d9e-ae13-eb88ec1242ca tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 047748f3-80f4-4fd5-a32a-18bf0a4a6e32] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:36.175042 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-307f4b0e-3142-4d9e-ae13-eb88ec1242ca tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:36.175486 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-307f4b0e-3142-4d9e-ae13-eb88ec1242ca tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:36.176263 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-307f4b0e-3142-4d9e-ae13-eb88ec1242ca tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:36.176744 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-307f4b0e-3142-4d9e-ae13-eb88ec1242ca tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:36.282815 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-307f4b0e-3142-4d9e-ae13-eb88ec1242ca tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] HTTP exception thrown: Invalid volume: volume c2cb1082-dfa1-45d6-aa6c-cb4c98524734 is already attached to instances: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f Oct 28 08:41:36.284029 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-307f4b0e-3142-4d9e-ae13-eb88ec1242ca tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Returning 400 to user: Invalid volume: volume c2cb1082-dfa1-45d6-aa6c-cb4c98524734 is already attached to instances: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:41:36.285085 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-307f4b0e-3142-4d9e-ae13-eb88ec1242ca tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "POST /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.133423 Oct 28 08:41:36.286511 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 191/372] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Oct 28 08:41:36 2021] POST /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32/os-volume_attachments => generated 174 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 08:41:36.399643 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-624693f8-fb67-40a2-9110-5d4c9602df95 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:36.401396 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-624693f8-fb67-40a2-9110-5d4c9602df95 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:36.419046 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-624693f8-fb67-40a2-9110-5d4c9602df95 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:36.420564 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-624693f8-fb67-40a2-9110-5d4c9602df95 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:36.422313 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-624693f8-fb67-40a2-9110-5d4c9602df95 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:36.423387 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-624693f8-fb67-40a2-9110-5d4c9602df95 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:36.479536 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-5ba658af-c1ee-45bf-8369-7c3fc1baf9b2 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:36.521308 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5ba658af-c1ee-45bf-8369-7c3fc1baf9b2 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.406723 Oct 28 08:41:36.523420 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 182/373] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:36 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:36.692980 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-624693f8-fb67-40a2-9110-5d4c9602df95 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lazy-loading 'services' on Instance uuid 3127fb3d-04bf-4ef2-b534-cd6fd65f614f {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:41:36.765885 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-56ca5439-3ae5-4d0a-a505-b533ad63767e req-9afa2a11-d3a5-4aa9-b185-4f43d3becfc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e77c4e-c82e-4295-811a-8d992ea9209c", "name": "network-vif-deleted", "tag": "5c920b6d-61e7-4b04-9084-e8c83a6b11c7"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:36.780032 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:41:36.780032 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:41:36.812665 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-56ca5439-3ae5-4d0a-a505-b533ad63767e req-9afa2a11-d3a5-4aa9-b185-4f43d3becfc3 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:36.813568 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-56ca5439-3ae5-4d0a-a505-b533ad63767e req-9afa2a11-d3a5-4aa9-b185-4f43d3becfc3 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:36.845120 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-56ca5439-3ae5-4d0a-a505-b533ad63767e req-9afa2a11-d3a5-4aa9-b185-4f43d3becfc3 service nova] Creating event network-vif-deleted:5c920b6d-61e7-4b04-9084-e8c83a6b11c7 for instance 91e77c4e-c82e-4295-811a-8d992ea9209c on hv-cinder-81565 Oct 28 08:41:36.852259 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-56ca5439-3ae5-4d0a-a505-b533ad63767e req-9afa2a11-d3a5-4aa9-b185-4f43d3becfc3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093500 Oct 28 08:41:36.859131 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 183/374] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:41:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:41:36.894212 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-624693f8-fb67-40a2-9110-5d4c9602df95 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "DELETE /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f/os-volume_attachments/c2cb1082-dfa1-45d6-aa6c-cb4c98524734" status: 202 len: 0 microversion: 2.1 time: 0.499690 Oct 28 08:41:36.896840 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 192/375] 10.222.0.76 () {58 vars in 1415 bytes} [Thu Oct 28 08:41:36 2021] DELETE /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f/os-volume_attachments/c2cb1082-dfa1-45d6-aa6c-cb4c98524734 => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:41:36.906325 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f11b202d-67e8-48be-ad1b-7141c0032a2d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:36.908766 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f11b202d-67e8-48be-ad1b-7141c0032a2d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:36.920240 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f11b202d-67e8-48be-ad1b-7141c0032a2d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:36.926871 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f11b202d-67e8-48be-ad1b-7141c0032a2d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:36.928547 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f11b202d-67e8-48be-ad1b-7141c0032a2d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:36.929073 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f11b202d-67e8-48be-ad1b-7141c0032a2d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:36.977972 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7535b9ff-e5dc-4fb0-ac31-3b816bb1c1f6 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:36.978836 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7535b9ff-e5dc-4fb0-ac31-3b816bb1c1f6 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 91e77c4e-c82e-4295-811a-8d992ea9209c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:37.000352 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f11b202d-67e8-48be-ad1b-7141c0032a2d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099091 Oct 28 08:41:37.001546 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 184/376] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Oct 28 08:41:36 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:41:37.007031 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7535b9ff-e5dc-4fb0-ac31-3b816bb1c1f6 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:37.012416 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7535b9ff-e5dc-4fb0-ac31-3b816bb1c1f6 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:37.013675 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7535b9ff-e5dc-4fb0-ac31-3b816bb1c1f6 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:37.014387 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7535b9ff-e5dc-4fb0-ac31-3b816bb1c1f6 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:37.065470 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7535b9ff-e5dc-4fb0-ac31-3b816bb1c1f6 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:37.065985 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7535b9ff-e5dc-4fb0-ac31-3b816bb1c1f6 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:37.066569 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-7535b9ff-e5dc-4fb0-ac31-3b816bb1c1f6 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lazy-loading 'fault' on Instance uuid 91e77c4e-c82e-4295-811a-8d992ea9209c {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:41:37.126812 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b51e068d-7031-49c4-8aab-7acaf186abc0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:37.131422 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b51e068d-7031-49c4-8aab-7acaf186abc0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:37.143917 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-7535b9ff-e5dc-4fb0-ac31-3b816bb1c1f6 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:37.144312 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b51e068d-7031-49c4-8aab-7acaf186abc0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:37.144434 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b51e068d-7031-49c4-8aab-7acaf186abc0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:37.151905 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7535b9ff-e5dc-4fb0-ac31-3b816bb1c1f6 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c" status: 200 len: 1302 microversion: 2.1 time: 0.178919 Oct 28 08:41:37.152308 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b51e068d-7031-49c4-8aab-7acaf186abc0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:37.153466 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 193/377] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:36 2021] GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c => generated 1302 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:37.156344 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b51e068d-7031-49c4-8aab-7acaf186abc0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:37.166102 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5917da1c-b023-4282-b08f-ec6a96b5d8bb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:37.167093 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5917da1c-b023-4282-b08f-ec6a96b5d8bb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:37.174363 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5917da1c-b023-4282-b08f-ec6a96b5d8bb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:37.175554 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5917da1c-b023-4282-b08f-ec6a96b5d8bb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:37.177031 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5917da1c-b023-4282-b08f-ec6a96b5d8bb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:37.177813 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5917da1c-b023-4282-b08f-ec6a96b5d8bb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:37.325388 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b51e068d-7031-49c4-8aab-7acaf186abc0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 26570 microversion: 2.1 time: 0.204890 Oct 28 08:41:37.332086 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 185/378] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:37 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 26570 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:37.378757 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5917da1c-b023-4282-b08f-ec6a96b5d8bb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 26921 microversion: 2.20 time: 0.220119 Oct 28 08:41:37.381042 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 194/379] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:37 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 26921 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:41:37.542891 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6b84b8b3-67d6-4335-8ace-9a2dd52563df tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:37.544420 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6b84b8b3-67d6-4335-8ace-9a2dd52563df tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:37.555512 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b84b8b3-67d6-4335-8ace-9a2dd52563df tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:37.556238 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b84b8b3-67d6-4335-8ace-9a2dd52563df tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:37.557034 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b84b8b3-67d6-4335-8ace-9a2dd52563df tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:37.557663 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b84b8b3-67d6-4335-8ace-9a2dd52563df tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:37.824342 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-6b84b8b3-67d6-4335-8ace-9a2dd52563df tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:37.832758 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6b84b8b3-67d6-4335-8ace-9a2dd52563df tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.295401 Oct 28 08:41:37.833899 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 186/380] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:37 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:38.017892 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-85f275c5-2237-4917-b248-a5ac1b218444 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:38.019595 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-85f275c5-2237-4917-b248-a5ac1b218444 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:38.036778 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85f275c5-2237-4917-b248-a5ac1b218444 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:38.037918 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85f275c5-2237-4917-b248-a5ac1b218444 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:38.039529 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85f275c5-2237-4917-b248-a5ac1b218444 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:38.040594 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85f275c5-2237-4917-b248-a5ac1b218444 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:38.136651 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-85f275c5-2237-4917-b248-a5ac1b218444 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127362 Oct 28 08:41:38.138052 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 195/381] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Oct 28 08:41:38 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:41:38.173693 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7c096451-40a6-4f3f-aba3-a7aad8f0ab57 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:38.174351 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7c096451-40a6-4f3f-aba3-a7aad8f0ab57 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 91e77c4e-c82e-4295-811a-8d992ea9209c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:38.184522 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c096451-40a6-4f3f-aba3-a7aad8f0ab57 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:38.185109 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c096451-40a6-4f3f-aba3-a7aad8f0ab57 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:38.185914 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c096451-40a6-4f3f-aba3-a7aad8f0ab57 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:38.186621 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c096451-40a6-4f3f-aba3-a7aad8f0ab57 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:38.204431 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-7c096451-40a6-4f3f-aba3-a7aad8f0ab57 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] HTTP exception thrown: Instance 91e77c4e-c82e-4295-811a-8d992ea9209c could not be found. Oct 28 08:41:38.205272 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7c096451-40a6-4f3f-aba3-a7aad8f0ab57 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Returning 404 to user: Instance 91e77c4e-c82e-4295-811a-8d992ea9209c could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:41:38.206111 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7c096451-40a6-4f3f-aba3-a7aad8f0ab57 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c" status: 404 len: 111 microversion: 2.1 time: 0.038714 Oct 28 08:41:38.206697 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 187/382] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:38 2021] GET /compute/v2.1/servers/91e77c4e-c82e-4295-811a-8d992ea9209c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:41:38.334921 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-86fbb4ae-6d71-488d-b646-876c8d1c1dbd tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-156432454", "imageRef": "339e99be-6a19-4324-aa16-6b690c25dede", "flavorRef": "452", "networks": [{"uuid": "35415b19-1403-4733-b6cb-03e1bd171af3"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:38.342838 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3f41feed-9e37-4a1f-bd53-9e00244fd04e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:38.343841 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3f41feed-9e37-4a1f-bd53-9e00244fd04e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:38.353919 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f41feed-9e37-4a1f-bd53-9e00244fd04e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:38.358856 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f41feed-9e37-4a1f-bd53-9e00244fd04e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:38.373079 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f41feed-9e37-4a1f-bd53-9e00244fd04e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:38.373168 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f41feed-9e37-4a1f-bd53-9e00244fd04e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:38.447273 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-86fbb4ae-6d71-488d-b646-876c8d1c1dbd tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] validate_networks() for [('35415b19-1403-4733-b6cb-03e1bd171af3', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:41:38.516489 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3f41feed-9e37-4a1f-bd53-9e00244fd04e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 27093 microversion: 2.1 time: 0.176893 Oct 28 08:41:38.517152 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 188/383] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:38 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 27093 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:41:38.533292 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dcfdf858-a782-44ec-b566-ac3d60698e71 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:38.533408 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dcfdf858-a782-44ec-b566-ac3d60698e71 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:38.549118 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dcfdf858-a782-44ec-b566-ac3d60698e71 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:38.549686 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dcfdf858-a782-44ec-b566-ac3d60698e71 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:38.550646 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dcfdf858-a782-44ec-b566-ac3d60698e71 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:38.551088 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dcfdf858-a782-44ec-b566-ac3d60698e71 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:38.737787 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dcfdf858-a782-44ec-b566-ac3d60698e71 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 27486 microversion: 2.20 time: 0.215237 Oct 28 08:41:38.738881 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 189/384] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:38 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 27486 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:41:38.866657 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0c2e34f8-2ac1-41c5-bb44-296d16ee66a0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:38.867776 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0c2e34f8-2ac1-41c5-bb44-296d16ee66a0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:38.881808 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c2e34f8-2ac1-41c5-bb44-296d16ee66a0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:38.882333 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c2e34f8-2ac1-41c5-bb44-296d16ee66a0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:38.883065 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c2e34f8-2ac1-41c5-bb44-296d16ee66a0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:38.883752 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c2e34f8-2ac1-41c5-bb44-296d16ee66a0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:39.102392 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-86fbb4ae-6d71-488d-b646-876c8d1c1dbd tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:41:39.103602 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-86fbb4ae-6d71-488d-b646-876c8d1c1dbd tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:41:39.104704 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-86fbb4ae-6d71-488d-b646-876c8d1c1dbd tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:41:39.105119 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-86fbb4ae-6d71-488d-b646-876c8d1c1dbd tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:41:39.105784 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-86fbb4ae-6d71-488d-b646-876c8d1c1dbd tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:41:39.117693 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86fbb4ae-6d71-488d-b646-876c8d1c1dbd tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:39.118310 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86fbb4ae-6d71-488d-b646-876c8d1c1dbd tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:39.119353 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86fbb4ae-6d71-488d-b646-876c8d1c1dbd tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:39.119948 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86fbb4ae-6d71-488d-b646-876c8d1c1dbd tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:39.144288 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-86fbb4ae-6d71-488d-b646-876c8d1c1dbd tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Getting quotas for project 273c545d66f0479bb21eb8012fb29558. Resources: {'instances', 'cores', 'ram'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:41:39.148752 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-86fbb4ae-6d71-488d-b646-876c8d1c1dbd tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Getting quotas for user 5df79cdd584947ff967966692375c45c and project 273c545d66f0479bb21eb8012fb29558. Resources: {'instances', 'cores', 'ram'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:41:39.163649 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-86fbb4ae-6d71-488d-b646-876c8d1c1dbd tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:41:39.166305 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-86fbb4ae-6d71-488d-b646-876c8d1c1dbd tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='339e99be-6a19-4324-aa16-6b690c25dede',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:41:39.169631 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-0c2e34f8-2ac1-41c5-bb44-296d16ee66a0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:39.196929 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0c2e34f8-2ac1-41c5-bb44-296d16ee66a0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.344577 Oct 28 08:41:39.198270 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 190/385] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:38 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:39.204939 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4643d8ec-7f8b-42fc-9d48-8dc65b1168ad tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:39.206314 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4643d8ec-7f8b-42fc-9d48-8dc65b1168ad tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:39.221263 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4643d8ec-7f8b-42fc-9d48-8dc65b1168ad tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:39.221966 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4643d8ec-7f8b-42fc-9d48-8dc65b1168ad tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:39.223015 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4643d8ec-7f8b-42fc-9d48-8dc65b1168ad tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:39.223970 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4643d8ec-7f8b-42fc-9d48-8dc65b1168ad tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:39.238420 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-86fbb4ae-6d71-488d-b646-876c8d1c1dbd tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.908484 Oct 28 08:41:39.239749 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 196/386] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Oct 28 08:41:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:41:39.257157 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d65dfa73-27d4-4852-91f7-635099fda8b8 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:39.258236 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d65dfa73-27d4-4852-91f7-635099fda8b8 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:39.333999 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4643d8ec-7f8b-42fc-9d48-8dc65b1168ad tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.134067 Oct 28 08:41:39.335023 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 191/387] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Oct 28 08:41:39 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f/os-volume_attachments => generated 25 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:41:39.343776 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-d65dfa73-27d4-4852-91f7-635099fda8b8 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:39.352420 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d65dfa73-27d4-4852-91f7-635099fda8b8 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1213 microversion: 2.1 time: 0.105663 Oct 28 08:41:39.353080 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 197/388] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:39 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1213 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:39.530966 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-784206d9-a7da-4598-a6fe-07a97fe83916 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:39.533644 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-784206d9-a7da-4598-a6fe-07a97fe83916 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:39.550774 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b5f5ad38-65c7-492b-8706-3dba326d9e79 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1383070253", "imageRef": "339e99be-6a19-4324-aa16-6b690c25dede", "flavorRef": "452", "networks": [{"uuid": "baa97c96-d90c-4541-963c-2b8ac01daede"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:39.559806 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-784206d9-a7da-4598-a6fe-07a97fe83916 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:39.560253 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-784206d9-a7da-4598-a6fe-07a97fe83916 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:39.561044 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-784206d9-a7da-4598-a6fe-07a97fe83916 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:39.561472 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-784206d9-a7da-4598-a6fe-07a97fe83916 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:39.638692 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-b5f5ad38-65c7-492b-8706-3dba326d9e79 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] validate_networks() for [('baa97c96-d90c-4541-963c-2b8ac01daede', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:41:39.688383 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-784206d9-a7da-4598-a6fe-07a97fe83916 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 27559 microversion: 2.1 time: 0.162113 Oct 28 08:41:39.692503 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 192/389] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:39 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 27559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:41:39.778651 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c685f547-2d8d-462c-9a63-5860cce8b752 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:39.780296 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c685f547-2d8d-462c-9a63-5860cce8b752 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:39.793556 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c685f547-2d8d-462c-9a63-5860cce8b752 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:39.796939 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c685f547-2d8d-462c-9a63-5860cce8b752 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:39.800598 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c685f547-2d8d-462c-9a63-5860cce8b752 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:39.804020 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c685f547-2d8d-462c-9a63-5860cce8b752 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:39.958977 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c685f547-2d8d-462c-9a63-5860cce8b752 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 27730 microversion: 2.20 time: 0.209885 Oct 28 08:41:39.960957 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 193/390] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:39 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 27730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:41:40.238328 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-47b85c24-3153-41c2-a561-7dc2f917dad0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:40.240321 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-47b85c24-3153-41c2-a561-7dc2f917dad0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:40.255719 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47b85c24-3153-41c2-a561-7dc2f917dad0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:40.256401 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47b85c24-3153-41c2-a561-7dc2f917dad0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:40.257661 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47b85c24-3153-41c2-a561-7dc2f917dad0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:40.258172 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47b85c24-3153-41c2-a561-7dc2f917dad0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:40.456668 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-47b85c24-3153-41c2-a561-7dc2f917dad0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:40.469786 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-47b85c24-3153-41c2-a561-7dc2f917dad0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.243836 Oct 28 08:41:40.471427 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 194/391] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:40 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:40.478037 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9aff00b3-18e8-47d8-9581-e721acee5daa tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:40.479333 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9aff00b3-18e8-47d8-9581-e721acee5daa tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:40.486344 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9aff00b3-18e8-47d8-9581-e721acee5daa tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:40.486905 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9aff00b3-18e8-47d8-9581-e721acee5daa tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:40.487848 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9aff00b3-18e8-47d8-9581-e721acee5daa tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:40.488355 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9aff00b3-18e8-47d8-9581-e721acee5daa tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:40.575230 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b5f5ad38-65c7-492b-8706-3dba326d9e79 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:41:40.576660 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b5f5ad38-65c7-492b-8706-3dba326d9e79 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:41:40.576844 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b5f5ad38-65c7-492b-8706-3dba326d9e79 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:41:40.577284 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b5f5ad38-65c7-492b-8706-3dba326d9e79 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:41:40.578526 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b5f5ad38-65c7-492b-8706-3dba326d9e79 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:41:40.595841 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-9aff00b3-18e8-47d8-9581-e721acee5daa tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:40.607410 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5f5ad38-65c7-492b-8706-3dba326d9e79 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:40.607830 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9aff00b3-18e8-47d8-9581-e721acee5daa tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1265 microversion: 2.1 time: 0.134109 Oct 28 08:41:40.608758 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 195/392] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:40 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1265 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:40.614895 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5f5ad38-65c7-492b-8706-3dba326d9e79 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:40.617068 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5f5ad38-65c7-492b-8706-3dba326d9e79 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:40.619218 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5f5ad38-65c7-492b-8706-3dba326d9e79 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:40.650936 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-b5f5ad38-65c7-492b-8706-3dba326d9e79 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Getting quotas for project 3831003e70cf4a62afb1393fbea6654e. Resources: {'instances', 'cores', 'ram'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:41:40.655858 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-b5f5ad38-65c7-492b-8706-3dba326d9e79 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Getting quotas for user e0a3f84e4d9b4c77aab465f1e4df493d and project 3831003e70cf4a62afb1393fbea6654e. Resources: {'instances', 'cores', 'ram'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:41:40.669598 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b5f5ad38-65c7-492b-8706-3dba326d9e79 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:41:40.673127 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b5f5ad38-65c7-492b-8706-3dba326d9e79 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='339e99be-6a19-4324-aa16-6b690c25dede',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:41:40.701621 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e2a3e7b8-ca9f-4423-9501-7def46fcecb5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:40.702829 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e2a3e7b8-ca9f-4423-9501-7def46fcecb5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:40.710749 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2a3e7b8-ca9f-4423-9501-7def46fcecb5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:40.710749 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2a3e7b8-ca9f-4423-9501-7def46fcecb5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:40.711707 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2a3e7b8-ca9f-4423-9501-7def46fcecb5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:40.712313 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2a3e7b8-ca9f-4423-9501-7def46fcecb5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:40.742092 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b5f5ad38-65c7-492b-8706-3dba326d9e79 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.201369 Oct 28 08:41:40.744027 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 198/393] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Oct 28 08:41:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 1206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:41:40.754013 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ce78b733-e4b4-4723-aa43-2b55676d0ef5 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:40.755020 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ce78b733-e4b4-4723-aa43-2b55676d0ef5 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:40.867970 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e2a3e7b8-ca9f-4423-9501-7def46fcecb5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 27784 microversion: 2.1 time: 0.171049 Oct 28 08:41:40.869406 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 196/394] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:40 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 27784 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:41:40.892971 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-ce78b733-e4b4-4723-aa43-2b55676d0ef5 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:40.905689 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ce78b733-e4b4-4723-aa43-2b55676d0ef5 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1218 microversion: 2.1 time: 0.154570 Oct 28 08:41:40.910336 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 199/395] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:40 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1218 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:40.980234 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e101858a-c067-44ae-8880-cd6747a741ef tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:40.982010 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e101858a-c067-44ae-8880-cd6747a741ef tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:40.994189 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e101858a-c067-44ae-8880-cd6747a741ef tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:40.995293 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e101858a-c067-44ae-8880-cd6747a741ef tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:40.996536 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e101858a-c067-44ae-8880-cd6747a741ef tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:40.997323 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e101858a-c067-44ae-8880-cd6747a741ef tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:41.130857 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e101858a-c067-44ae-8880-cd6747a741ef tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 27969 microversion: 2.20 time: 0.154591 Oct 28 08:41:41.131594 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 197/396] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:40 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 27969 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:41:41.489355 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e13f29cc-ad80-4b1d-a57d-817f7377a231 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:41.490272 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e13f29cc-ad80-4b1d-a57d-817f7377a231 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:41.498473 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e13f29cc-ad80-4b1d-a57d-817f7377a231 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:41.499352 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e13f29cc-ad80-4b1d-a57d-817f7377a231 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:41.500958 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e13f29cc-ad80-4b1d-a57d-817f7377a231 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:41.501609 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e13f29cc-ad80-4b1d-a57d-817f7377a231 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:41.628622 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-809668b5-a976-48c2-a449-c6392fd2c715 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:41.630352 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-809668b5-a976-48c2-a449-c6392fd2c715 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:41.639201 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-809668b5-a976-48c2-a449-c6392fd2c715 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:41.639664 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-809668b5-a976-48c2-a449-c6392fd2c715 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:41.640678 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-809668b5-a976-48c2-a449-c6392fd2c715 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:41.642010 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-809668b5-a976-48c2-a449-c6392fd2c715 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:41.755476 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-809668b5-a976-48c2-a449-c6392fd2c715 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:41.769940 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-809668b5-a976-48c2-a449-c6392fd2c715 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1271 microversion: 2.1 time: 0.146091 Oct 28 08:41:41.771174 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 198/397] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:41 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1271 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:41.854109 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-e13f29cc-ad80-4b1d-a57d-817f7377a231 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:41.861917 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e13f29cc-ad80-4b1d-a57d-817f7377a231 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.376942 Oct 28 08:41:41.871314 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 200/398] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:41 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:41.880261 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b9dd49ad-4115-4930-b0d3-9f9eb395597a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:41.881537 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b9dd49ad-4115-4930-b0d3-9f9eb395597a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:41.889385 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9dd49ad-4115-4930-b0d3-9f9eb395597a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:41.891654 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9dd49ad-4115-4930-b0d3-9f9eb395597a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:41.892516 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9dd49ad-4115-4930-b0d3-9f9eb395597a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:41.892972 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9dd49ad-4115-4930-b0d3-9f9eb395597a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:41.929221 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f44e7c78-5326-4636-a46a-a1aea7e5f840 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:41.930196 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f44e7c78-5326-4636-a46a-a1aea7e5f840 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:41.938107 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f44e7c78-5326-4636-a46a-a1aea7e5f840 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:41.939083 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f44e7c78-5326-4636-a46a-a1aea7e5f840 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:41.939980 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f44e7c78-5326-4636-a46a-a1aea7e5f840 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:41.940512 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f44e7c78-5326-4636-a46a-a1aea7e5f840 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:42.045874 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-f44e7c78-5326-4636-a46a-a1aea7e5f840 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:42.061716 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f44e7c78-5326-4636-a46a-a1aea7e5f840 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1270 microversion: 2.1 time: 0.138218 Oct 28 08:41:42.062338 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 201/399] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:41 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1270 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:42.085183 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b9dd49ad-4115-4930-b0d3-9f9eb395597a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 27972 microversion: 2.1 time: 0.209121 Oct 28 08:41:42.086418 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 199/400] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:41 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 27972 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:41:42.145957 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8bd5d7ba-230b-4ff5-ba50-f83c04945b69 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:42.146976 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8bd5d7ba-230b-4ff5-ba50-f83c04945b69 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:42.153270 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bd5d7ba-230b-4ff5-ba50-f83c04945b69 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:42.153706 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bd5d7ba-230b-4ff5-ba50-f83c04945b69 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:42.154472 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bd5d7ba-230b-4ff5-ba50-f83c04945b69 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:42.155007 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bd5d7ba-230b-4ff5-ba50-f83c04945b69 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:42.337983 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8bd5d7ba-230b-4ff5-ba50-f83c04945b69 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28053 microversion: 2.20 time: 0.198813 Oct 28 08:41:42.342476 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 202/401] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:42 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28053 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:41:42.788658 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-51fbfa14-7b51-462c-8d3d-38c5d7b9f434 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:42.789533 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-51fbfa14-7b51-462c-8d3d-38c5d7b9f434 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:42.796499 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51fbfa14-7b51-462c-8d3d-38c5d7b9f434 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:42.798911 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51fbfa14-7b51-462c-8d3d-38c5d7b9f434 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:42.799991 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51fbfa14-7b51-462c-8d3d-38c5d7b9f434 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:42.800639 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51fbfa14-7b51-462c-8d3d-38c5d7b9f434 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:42.879490 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6f0aa91b-53ce-4480-9c5a-8b145b808ef7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:42.882189 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6f0aa91b-53ce-4480-9c5a-8b145b808ef7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:42.890136 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f0aa91b-53ce-4480-9c5a-8b145b808ef7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:42.890868 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f0aa91b-53ce-4480-9c5a-8b145b808ef7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:42.892413 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f0aa91b-53ce-4480-9c5a-8b145b808ef7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:42.893294 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f0aa91b-53ce-4480-9c5a-8b145b808ef7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:43.192196 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-51fbfa14-7b51-462c-8d3d-38c5d7b9f434 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:43.200920 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-51fbfa14-7b51-462c-8d3d-38c5d7b9f434 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1313 microversion: 2.1 time: 0.416360 Oct 28 08:41:43.201115 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-6f0aa91b-53ce-4480-9c5a-8b145b808ef7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:43.201558 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 200/402] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:42 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1313 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:43.207731 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-85fd6540-69e9-43d7-ad4e-8cfd63641b94 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:43.208696 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-85fd6540-69e9-43d7-ad4e-8cfd63641b94 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:43.216108 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85fd6540-69e9-43d7-ad4e-8cfd63641b94 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:43.216549 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85fd6540-69e9-43d7-ad4e-8cfd63641b94 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:43.217329 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85fd6540-69e9-43d7-ad4e-8cfd63641b94 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:43.217456 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6f0aa91b-53ce-4480-9c5a-8b145b808ef7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.342543 Oct 28 08:41:43.217806 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85fd6540-69e9-43d7-ad4e-8cfd63641b94 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:43.218338 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 203/403] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:42 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:43.226740 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dbde2c65-6c55-49a7-9ad7-f15e9af6b6c6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:43.228595 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dbde2c65-6c55-49a7-9ad7-f15e9af6b6c6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:43.237812 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dbde2c65-6c55-49a7-9ad7-f15e9af6b6c6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:43.238405 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dbde2c65-6c55-49a7-9ad7-f15e9af6b6c6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:43.240315 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dbde2c65-6c55-49a7-9ad7-f15e9af6b6c6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:43.241079 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dbde2c65-6c55-49a7-9ad7-f15e9af6b6c6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:43.327687 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-85fd6540-69e9-43d7-ad4e-8cfd63641b94 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:43.335632 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-85fd6540-69e9-43d7-ad4e-8cfd63641b94 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1276 microversion: 2.1 time: 0.132874 Oct 28 08:41:43.336419 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 201/404] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:43 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1276 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:43.340835 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-9dec0c91-7288-4fd3-a83a-d8044789a129 req-b417355c-24d7-4d71-900f-1edd19ee3b32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3", "tag": "9be23939-416b-4e30-86a9-026576b06e86"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:43.343005 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:41:43.343005 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:41:43.351090 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9dec0c91-7288-4fd3-a83a-d8044789a129 req-b417355c-24d7-4d71-900f-1edd19ee3b32 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:43.351524 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9dec0c91-7288-4fd3-a83a-d8044789a129 req-b417355c-24d7-4d71-900f-1edd19ee3b32 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:43.363359 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-9dec0c91-7288-4fd3-a83a-d8044789a129 req-b417355c-24d7-4d71-900f-1edd19ee3b32 service nova] Creating event network-changed:9be23939-416b-4e30-86a9-026576b06e86 for instance 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 on hv-cinder-81565 Oct 28 08:41:43.368255 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-9dec0c91-7288-4fd3-a83a-d8044789a129 req-b417355c-24d7-4d71-900f-1edd19ee3b32 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030943 Oct 28 08:41:43.368837 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 202/405] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:41:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:41:43.374441 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c0e1d734-1b20-4326-b3f2-e48ac45bc2e9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:43.376109 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c0e1d734-1b20-4326-b3f2-e48ac45bc2e9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:43.382346 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0e1d734-1b20-4326-b3f2-e48ac45bc2e9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:43.382827 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0e1d734-1b20-4326-b3f2-e48ac45bc2e9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:43.383605 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0e1d734-1b20-4326-b3f2-e48ac45bc2e9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:43.384039 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0e1d734-1b20-4326-b3f2-e48ac45bc2e9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:46.350034 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dbde2c65-6c55-49a7-9ad7-f15e9af6b6c6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28089 microversion: 2.1 time: 3.129562 Oct 28 08:41:46.354301 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 204/406] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:43 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28089 bytes in 3132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:46.355771 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cc51b15e-40d8-4aa9-bf89-28c56bb81ae2 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:46.356479 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cc51b15e-40d8-4aa9-bf89-28c56bb81ae2 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:46.371635 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc51b15e-40d8-4aa9-bf89-28c56bb81ae2 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:46.372320 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc51b15e-40d8-4aa9-bf89-28c56bb81ae2 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:46.373251 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc51b15e-40d8-4aa9-bf89-28c56bb81ae2 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:46.373844 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc51b15e-40d8-4aa9-bf89-28c56bb81ae2 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:46.393634 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c0e1d734-1b20-4326-b3f2-e48ac45bc2e9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 3.023219 Oct 28 08:41:46.401489 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 203/407] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:43 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 3032 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:41:46.407909 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-58141760-e10b-4fbc-94bb-ec37f66750d1 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:46.409058 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-58141760-e10b-4fbc-94bb-ec37f66750d1 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:46.416684 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58141760-e10b-4fbc-94bb-ec37f66750d1 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:46.417688 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58141760-e10b-4fbc-94bb-ec37f66750d1 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:46.418511 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58141760-e10b-4fbc-94bb-ec37f66750d1 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:46.419059 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58141760-e10b-4fbc-94bb-ec37f66750d1 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:46.655247 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-cc51b15e-40d8-4aa9-bf89-28c56bb81ae2 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:46.663129 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cc51b15e-40d8-4aa9-bf89-28c56bb81ae2 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1313 microversion: 2.1 time: 0.311191 Oct 28 08:41:46.663700 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 205/408] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:46 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:46.677098 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2c733653-805c-463b-812e-e1ba9467edcb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:46.679368 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-58141760-e10b-4fbc-94bb-ec37f66750d1 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:46.680210 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2c733653-805c-463b-812e-e1ba9467edcb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:46.691203 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-58141760-e10b-4fbc-94bb-ec37f66750d1 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.288132 Oct 28 08:41:46.691992 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 204/409] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:46 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:46.695234 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c733653-805c-463b-812e-e1ba9467edcb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:46.695666 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c733653-805c-463b-812e-e1ba9467edcb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:46.696425 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c733653-805c-463b-812e-e1ba9467edcb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:46.696835 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c733653-805c-463b-812e-e1ba9467edcb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:46.768207 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-2c733653-805c-463b-812e-e1ba9467edcb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:46.778275 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2c733653-805c-463b-812e-e1ba9467edcb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1276 microversion: 2.1 time: 0.113351 Oct 28 08:41:46.781841 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 206/410] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:46 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1276 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:47.362337 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3ba4e69f-9f92-491d-9a64-92ff09d3cb50 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:47.363394 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3ba4e69f-9f92-491d-9a64-92ff09d3cb50 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:47.379292 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ba4e69f-9f92-491d-9a64-92ff09d3cb50 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:47.382528 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ba4e69f-9f92-491d-9a64-92ff09d3cb50 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:47.383708 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ba4e69f-9f92-491d-9a64-92ff09d3cb50 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:47.384992 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ba4e69f-9f92-491d-9a64-92ff09d3cb50 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:47.421801 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c084b8ef-15d7-4a31-b159-39b29066d64d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:47.423009 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c084b8ef-15d7-4a31-b159-39b29066d64d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:47.448620 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c084b8ef-15d7-4a31-b159-39b29066d64d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:47.455265 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c084b8ef-15d7-4a31-b159-39b29066d64d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:47.456422 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c084b8ef-15d7-4a31-b159-39b29066d64d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:47.457427 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c084b8ef-15d7-4a31-b159-39b29066d64d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:47.546085 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3ba4e69f-9f92-491d-9a64-92ff09d3cb50 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28089 microversion: 2.1 time: 0.187779 Oct 28 08:41:47.547467 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 205/411] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:47 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28089 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:47.681769 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0a519f68-9fe9-4d45-846c-95bdcc840c3b tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:47.682470 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0a519f68-9fe9-4d45-846c-95bdcc840c3b tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:47.690083 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a519f68-9fe9-4d45-846c-95bdcc840c3b tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:47.690558 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a519f68-9fe9-4d45-846c-95bdcc840c3b tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:47.691343 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a519f68-9fe9-4d45-846c-95bdcc840c3b tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:47.691777 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a519f68-9fe9-4d45-846c-95bdcc840c3b tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:47.841302 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c084b8ef-15d7-4a31-b159-39b29066d64d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 0.436032 Oct 28 08:41:47.847580 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 207/412] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:47 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:41:47.851242 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b7765099-b302-4f13-a9a6-747b4ea6606a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:47.852274 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b7765099-b302-4f13-a9a6-747b4ea6606a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:47.868183 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7765099-b302-4f13-a9a6-747b4ea6606a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:47.868183 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7765099-b302-4f13-a9a6-747b4ea6606a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:47.868183 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7765099-b302-4f13-a9a6-747b4ea6606a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:47.868183 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7765099-b302-4f13-a9a6-747b4ea6606a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:48.051284 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-0a519f68-9fe9-4d45-846c-95bdcc840c3b tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:48.058467 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0a519f68-9fe9-4d45-846c-95bdcc840c3b tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1313 microversion: 2.1 time: 0.380780 Oct 28 08:41:48.059059 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 206/413] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:47 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1313 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:48.063906 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c0fb9efc-73d3-4b77-bb7d-69c4a18ad67c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:48.064507 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c0fb9efc-73d3-4b77-bb7d-69c4a18ad67c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:48.070276 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0fb9efc-73d3-4b77-bb7d-69c4a18ad67c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:48.070757 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0fb9efc-73d3-4b77-bb7d-69c4a18ad67c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:48.071529 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0fb9efc-73d3-4b77-bb7d-69c4a18ad67c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:48.071961 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0fb9efc-73d3-4b77-bb7d-69c4a18ad67c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:48.265585 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-b7765099-b302-4f13-a9a6-747b4ea6606a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:48.275111 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b7765099-b302-4f13-a9a6-747b4ea6606a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.431132 Oct 28 08:41:48.276611 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 208/414] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:47 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:48.436537 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c0fb9efc-73d3-4b77-bb7d-69c4a18ad67c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:48.444670 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c0fb9efc-73d3-4b77-bb7d-69c4a18ad67c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1318 microversion: 2.1 time: 0.384570 Oct 28 08:41:48.445251 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 207/415] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:48 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:48.559099 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f431c7e6-8d1b-4aa3-97cf-3f029f94ea9f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:48.560397 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f431c7e6-8d1b-4aa3-97cf-3f029f94ea9f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:48.568211 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f431c7e6-8d1b-4aa3-97cf-3f029f94ea9f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:48.568735 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f431c7e6-8d1b-4aa3-97cf-3f029f94ea9f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:48.569983 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f431c7e6-8d1b-4aa3-97cf-3f029f94ea9f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:48.570477 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f431c7e6-8d1b-4aa3-97cf-3f029f94ea9f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:48.794116 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-bdc1a3ea-b21d-4e92-ba3e-a695afca8107 req-60113a43-4d92-47cf-a71e-07dbffa8a356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "174ae5e4-f21b-4141-88bf-98e7d5efb161", "tag": "959d849c-17d9-4e15-b426-749af75d8b93"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:48.796203 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:41:48.796203 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:41:48.805152 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-bdc1a3ea-b21d-4e92-ba3e-a695afca8107 req-60113a43-4d92-47cf-a71e-07dbffa8a356 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:48.805754 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-bdc1a3ea-b21d-4e92-ba3e-a695afca8107 req-60113a43-4d92-47cf-a71e-07dbffa8a356 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:48.820300 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-bdc1a3ea-b21d-4e92-ba3e-a695afca8107 req-60113a43-4d92-47cf-a71e-07dbffa8a356 service nova] Creating event network-changed:959d849c-17d9-4e15-b426-749af75d8b93 for instance 174ae5e4-f21b-4141-88bf-98e7d5efb161 on hv-cinder-81565 Oct 28 08:41:48.825735 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-bdc1a3ea-b21d-4e92-ba3e-a695afca8107 req-60113a43-4d92-47cf-a71e-07dbffa8a356 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035107 Oct 28 08:41:48.826300 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 208/416] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:41:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:41:48.855969 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d7947ac8-b711-4338-82ee-e21c96ee2ccc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:48.857102 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d7947ac8-b711-4338-82ee-e21c96ee2ccc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:48.863875 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7947ac8-b711-4338-82ee-e21c96ee2ccc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:48.864320 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7947ac8-b711-4338-82ee-e21c96ee2ccc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:48.865088 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7947ac8-b711-4338-82ee-e21c96ee2ccc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:48.865551 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7947ac8-b711-4338-82ee-e21c96ee2ccc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:53.920330 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d7947ac8-b711-4338-82ee-e21c96ee2ccc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 5.068338 Oct 28 08:41:53.921057 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 209/417] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:48 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 5070 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:41:53.926491 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b1c39f8c-dbb5-4421-a4d7-f416e43dc429 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:53.927165 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b1c39f8c-dbb5-4421-a4d7-f416e43dc429 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:53.933977 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1c39f8c-dbb5-4421-a4d7-f416e43dc429 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:53.934419 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1c39f8c-dbb5-4421-a4d7-f416e43dc429 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:53.935237 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1c39f8c-dbb5-4421-a4d7-f416e43dc429 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:53.935730 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1c39f8c-dbb5-4421-a4d7-f416e43dc429 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:53.942032 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f431c7e6-8d1b-4aa3-97cf-3f029f94ea9f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 5.386952 Oct 28 08:41:53.942721 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 209/418] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:48 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 5388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:41:53.948039 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-94d1f67d-6dba-4628-a549-e5b1313587e2 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:53.948733 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-94d1f67d-6dba-4628-a549-e5b1313587e2 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:53.956782 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94d1f67d-6dba-4628-a549-e5b1313587e2 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:53.957086 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94d1f67d-6dba-4628-a549-e5b1313587e2 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:53.957854 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94d1f67d-6dba-4628-a549-e5b1313587e2 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:53.958242 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94d1f67d-6dba-4628-a549-e5b1313587e2 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:54.208405 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-b1c39f8c-dbb5-4421-a4d7-f416e43dc429 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:54.216095 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b1c39f8c-dbb5-4421-a4d7-f416e43dc429 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1313 microversion: 2.1 time: 0.293339 Oct 28 08:41:54.216704 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 210/419] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:53 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:54.224400 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-94d1f67d-6dba-4628-a549-e5b1313587e2 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:54.227658 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-889c2c07-d8e8-4206-a129-c7338db386ad tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:54.228378 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-889c2c07-d8e8-4206-a129-c7338db386ad tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:54.232367 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-94d1f67d-6dba-4628-a549-e5b1313587e2 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.288408 Oct 28 08:41:54.233831 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 210/420] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:53 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:54.234256 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-889c2c07-d8e8-4206-a129-c7338db386ad tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:54.235367 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-889c2c07-d8e8-4206-a129-c7338db386ad tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:54.236156 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-889c2c07-d8e8-4206-a129-c7338db386ad tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:54.236579 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-889c2c07-d8e8-4206-a129-c7338db386ad tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:54.366314 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-889c2c07-d8e8-4206-a129-c7338db386ad tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:54.374446 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-889c2c07-d8e8-4206-a129-c7338db386ad tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1318 microversion: 2.1 time: 0.156753 Oct 28 08:41:54.375137 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 211/421] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:54 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:54.932234 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fda178cf-40f0-42eb-b39b-d8abe3c28ffc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:54.933180 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fda178cf-40f0-42eb-b39b-d8abe3c28ffc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:54.940874 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fda178cf-40f0-42eb-b39b-d8abe3c28ffc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:54.941315 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fda178cf-40f0-42eb-b39b-d8abe3c28ffc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:54.942240 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fda178cf-40f0-42eb-b39b-d8abe3c28ffc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:54.942973 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fda178cf-40f0-42eb-b39b-d8abe3c28ffc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:54.953187 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9f14e2de-8847-40f3-8305-3ba9b1b39a59 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:54.954106 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9f14e2de-8847-40f3-8305-3ba9b1b39a59 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:54.960573 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f14e2de-8847-40f3-8305-3ba9b1b39a59 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:54.961029 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f14e2de-8847-40f3-8305-3ba9b1b39a59 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:54.961815 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f14e2de-8847-40f3-8305-3ba9b1b39a59 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:54.962253 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f14e2de-8847-40f3-8305-3ba9b1b39a59 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:55.443295 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fda178cf-40f0-42eb-b39b-d8abe3c28ffc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 0.514467 Oct 28 08:41:55.444855 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 211/422] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:54 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:41:55.446792 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9f14e2de-8847-40f3-8305-3ba9b1b39a59 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 0.497055 Oct 28 08:41:55.447874 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 212/423] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:54 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:41:55.449620 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-84de78e5-f99b-4b5b-bd32-c253e0bee578 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:55.450627 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-84de78e5-f99b-4b5b-bd32-c253e0bee578 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:55.454246 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0225de75-04c3-4293-92d9-e4c1e56fceca tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:55.455342 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0225de75-04c3-4293-92d9-e4c1e56fceca tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:55.459403 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84de78e5-f99b-4b5b-bd32-c253e0bee578 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:55.460072 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84de78e5-f99b-4b5b-bd32-c253e0bee578 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:55.460837 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84de78e5-f99b-4b5b-bd32-c253e0bee578 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:55.461257 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84de78e5-f99b-4b5b-bd32-c253e0bee578 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:55.461636 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0225de75-04c3-4293-92d9-e4c1e56fceca tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:55.462085 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0225de75-04c3-4293-92d9-e4c1e56fceca tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:55.463137 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0225de75-04c3-4293-92d9-e4c1e56fceca tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:55.463528 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0225de75-04c3-4293-92d9-e4c1e56fceca tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:55.760635 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-0225de75-04c3-4293-92d9-e4c1e56fceca tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:55.771475 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0225de75-04c3-4293-92d9-e4c1e56fceca tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.321327 Oct 28 08:41:55.773631 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 213/424] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:55 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:55.774073 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-84de78e5-f99b-4b5b-bd32-c253e0bee578 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:55.785210 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-629c2838-1110-4d09-9e99-8f7b004d3487 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:55.785906 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-629c2838-1110-4d09-9e99-8f7b004d3487 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:55.793724 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-84de78e5-f99b-4b5b-bd32-c253e0bee578 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1313 microversion: 2.1 time: 0.347947 Oct 28 08:41:55.801387 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 212/425] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:55 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1313 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:55.803164 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-629c2838-1110-4d09-9e99-8f7b004d3487 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:55.803686 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-629c2838-1110-4d09-9e99-8f7b004d3487 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:55.804693 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-629c2838-1110-4d09-9e99-8f7b004d3487 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:55.805436 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-629c2838-1110-4d09-9e99-8f7b004d3487 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:56.071928 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-629c2838-1110-4d09-9e99-8f7b004d3487 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:56.081014 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-629c2838-1110-4d09-9e99-8f7b004d3487 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1318 microversion: 2.1 time: 0.300163 Oct 28 08:41:56.081595 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 214/426] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:55 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:56.456796 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ce1c3e9a-88ba-48d8-9050-92439a43beff tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:56.458329 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ce1c3e9a-88ba-48d8-9050-92439a43beff tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:56.460157 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4cc12060-0b3a-492c-9221-74a73c579d9e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:56.461322 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4cc12060-0b3a-492c-9221-74a73c579d9e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:56.465401 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce1c3e9a-88ba-48d8-9050-92439a43beff tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:56.465956 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce1c3e9a-88ba-48d8-9050-92439a43beff tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:56.466915 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce1c3e9a-88ba-48d8-9050-92439a43beff tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:56.467689 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce1c3e9a-88ba-48d8-9050-92439a43beff tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:56.468597 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4cc12060-0b3a-492c-9221-74a73c579d9e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:56.469163 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4cc12060-0b3a-492c-9221-74a73c579d9e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:56.470061 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4cc12060-0b3a-492c-9221-74a73c579d9e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:56.470700 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4cc12060-0b3a-492c-9221-74a73c579d9e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:56.624301 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4cc12060-0b3a-492c-9221-74a73c579d9e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 0.167714 Oct 28 08:41:56.626652 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 215/427] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:56 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:41:56.632954 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ce1c3e9a-88ba-48d8-9050-92439a43beff tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 0.180506 Oct 28 08:41:56.633595 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 213/428] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:56 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:41:56.790533 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ceee4f5a-e0e0-48f1-91e4-3891abf45666 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:56.791158 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ceee4f5a-e0e0-48f1-91e4-3891abf45666 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:56.798289 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ceee4f5a-e0e0-48f1-91e4-3891abf45666 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:56.798769 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ceee4f5a-e0e0-48f1-91e4-3891abf45666 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:56.799703 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ceee4f5a-e0e0-48f1-91e4-3891abf45666 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:56.800142 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ceee4f5a-e0e0-48f1-91e4-3891abf45666 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:56.826800 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8f0dcdde-e922-4906-a3ad-6aee65735985 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:56.827492 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8f0dcdde-e922-4906-a3ad-6aee65735985 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:56.835447 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f0dcdde-e922-4906-a3ad-6aee65735985 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:56.835914 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f0dcdde-e922-4906-a3ad-6aee65735985 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:56.836777 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f0dcdde-e922-4906-a3ad-6aee65735985 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:56.837253 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f0dcdde-e922-4906-a3ad-6aee65735985 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:56.972500 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-ceee4f5a-e0e0-48f1-91e4-3891abf45666 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:56.980203 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ceee4f5a-e0e0-48f1-91e4-3891abf45666 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.193646 Oct 28 08:41:56.990467 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 216/429] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:56 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:57.013623 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-8f0dcdde-e922-4906-a3ad-6aee65735985 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:57.022121 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8f0dcdde-e922-4906-a3ad-6aee65735985 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1313 microversion: 2.1 time: 0.199245 Oct 28 08:41:57.031542 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 214/430] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:56 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:41:57.098138 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7f54fa7b-34af-4a4d-8ca4-603a9c0cbb5c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:41:57.101207 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7f54fa7b-34af-4a4d-8ca4-603a9c0cbb5c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:57.109676 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f54fa7b-34af-4a4d-8ca4-603a9c0cbb5c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:57.110311 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f54fa7b-34af-4a4d-8ca4-603a9c0cbb5c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:57.111299 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f54fa7b-34af-4a4d-8ca4-603a9c0cbb5c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:57.111736 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f54fa7b-34af-4a4d-8ca4-603a9c0cbb5c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:57.272951 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-7f54fa7b-34af-4a4d-8ca4-603a9c0cbb5c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:41:57.281722 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7f54fa7b-34af-4a4d-8ca4-603a9c0cbb5c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1318 microversion: 2.1 time: 0.187183 Oct 28 08:41:57.282274 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 217/431] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:41:57 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:41:57.636862 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-69d29855-c0f8-453f-a5ec-7c3701034d88 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:57.639413 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-69d29855-c0f8-453f-a5ec-7c3701034d88 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:57.644157 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9e98a4a3-acec-4bc8-8dd4-a6df6add0c5d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:41:57.645094 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9e98a4a3-acec-4bc8-8dd4-a6df6add0c5d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:41:57.645292 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-69d29855-c0f8-453f-a5ec-7c3701034d88 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:57.645697 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-69d29855-c0f8-453f-a5ec-7c3701034d88 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:57.646716 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-69d29855-c0f8-453f-a5ec-7c3701034d88 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:57.647211 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-69d29855-c0f8-453f-a5ec-7c3701034d88 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:57.651563 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e98a4a3-acec-4bc8-8dd4-a6df6add0c5d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:57.652019 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e98a4a3-acec-4bc8-8dd4-a6df6add0c5d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:41:57.652802 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e98a4a3-acec-4bc8-8dd4-a6df6add0c5d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:41:57.653261 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e98a4a3-acec-4bc8-8dd4-a6df6add0c5d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:00.309442 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-69d29855-c0f8-453f-a5ec-7c3701034d88 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 2.676007 Oct 28 08:42:00.312656 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 215/432] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:41:57 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 2678 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:00.316149 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-56c82a50-7d15-4a53-9f3d-35895b208fc6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:00.316840 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-56c82a50-7d15-4a53-9f3d-35895b208fc6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:00.323470 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56c82a50-7d15-4a53-9f3d-35895b208fc6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:00.323913 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56c82a50-7d15-4a53-9f3d-35895b208fc6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:00.324687 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56c82a50-7d15-4a53-9f3d-35895b208fc6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:00.325114 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56c82a50-7d15-4a53-9f3d-35895b208fc6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:00.474725 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-56c82a50-7d15-4a53-9f3d-35895b208fc6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:00.482885 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-56c82a50-7d15-4a53-9f3d-35895b208fc6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.171489 Oct 28 08:42:00.483464 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 216/433] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:00 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:00.488291 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ad8e8e4f-b4c5-4c7c-b783-5bc1ee1e4a31 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:00.488910 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ad8e8e4f-b4c5-4c7c-b783-5bc1ee1e4a31 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:00.495005 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad8e8e4f-b4c5-4c7c-b783-5bc1ee1e4a31 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:00.495442 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad8e8e4f-b4c5-4c7c-b783-5bc1ee1e4a31 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:00.496197 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad8e8e4f-b4c5-4c7c-b783-5bc1ee1e4a31 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:00.496619 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad8e8e4f-b4c5-4c7c-b783-5bc1ee1e4a31 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:00.636619 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-ad8e8e4f-b4c5-4c7c-b783-5bc1ee1e4a31 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:00.644703 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ad8e8e4f-b4c5-4c7c-b783-5bc1ee1e4a31 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1313 microversion: 2.1 time: 0.159681 Oct 28 08:42:00.645287 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 217/434] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:00 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:00.649607 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ac1aa98a-1d87-4665-8c9d-d2800f3e448a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:00.650199 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ac1aa98a-1d87-4665-8c9d-d2800f3e448a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:00.656284 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac1aa98a-1d87-4665-8c9d-d2800f3e448a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:00.656724 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac1aa98a-1d87-4665-8c9d-d2800f3e448a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:00.657492 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac1aa98a-1d87-4665-8c9d-d2800f3e448a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:00.657916 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac1aa98a-1d87-4665-8c9d-d2800f3e448a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:00.790555 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-ac1aa98a-1d87-4665-8c9d-d2800f3e448a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:00.803509 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ac1aa98a-1d87-4665-8c9d-d2800f3e448a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1318 microversion: 2.1 time: 0.156947 Oct 28 08:42:00.804434 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 218/435] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:00 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:01.322651 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-da01c175-bdbd-4028-859e-2dd9ea074ed5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:01.323670 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-da01c175-bdbd-4028-859e-2dd9ea074ed5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:01.330779 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da01c175-bdbd-4028-859e-2dd9ea074ed5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:01.331221 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da01c175-bdbd-4028-859e-2dd9ea074ed5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:01.331987 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da01c175-bdbd-4028-859e-2dd9ea074ed5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:01.332415 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da01c175-bdbd-4028-859e-2dd9ea074ed5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:01.853363 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9e98a4a3-acec-4bc8-8dd4-a6df6add0c5d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 4.212672 Oct 28 08:42:01.854129 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 218/436] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:41:57 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 4214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:42:01.860581 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b23ea243-f499-4230-b227-dcbf6b54f215 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:01.861290 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b23ea243-f499-4230-b227-dcbf6b54f215 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:01.868279 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b23ea243-f499-4230-b227-dcbf6b54f215 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:01.868729 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b23ea243-f499-4230-b227-dcbf6b54f215 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:01.869476 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b23ea243-f499-4230-b227-dcbf6b54f215 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:01.869896 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b23ea243-f499-4230-b227-dcbf6b54f215 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:02.001393 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-b23ea243-f499-4230-b227-dcbf6b54f215 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:02.009540 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b23ea243-f499-4230-b227-dcbf6b54f215 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.154146 Oct 28 08:42:02.010114 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 219/437] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:01 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:02.014473 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c8791a0d-22a8-45e1-a637-e230b2d84de2 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:02.015093 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c8791a0d-22a8-45e1-a637-e230b2d84de2 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:02.021180 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8791a0d-22a8-45e1-a637-e230b2d84de2 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:02.021631 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8791a0d-22a8-45e1-a637-e230b2d84de2 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:02.022400 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8791a0d-22a8-45e1-a637-e230b2d84de2 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:02.022855 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8791a0d-22a8-45e1-a637-e230b2d84de2 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:02.167944 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c8791a0d-22a8-45e1-a637-e230b2d84de2 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:02.176209 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c8791a0d-22a8-45e1-a637-e230b2d84de2 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1313 microversion: 2.1 time: 0.165029 Oct 28 08:42:02.176776 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 220/438] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:02 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:02.181111 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9979b166-107e-4507-9bc3-591cbb5f18de tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:02.181757 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9979b166-107e-4507-9bc3-591cbb5f18de tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:02.188320 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9979b166-107e-4507-9bc3-591cbb5f18de tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:02.188872 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9979b166-107e-4507-9bc3-591cbb5f18de tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:02.189648 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9979b166-107e-4507-9bc3-591cbb5f18de tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:02.190077 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9979b166-107e-4507-9bc3-591cbb5f18de tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:02.323505 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-9979b166-107e-4507-9bc3-591cbb5f18de tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:02.331237 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9979b166-107e-4507-9bc3-591cbb5f18de tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1318 microversion: 2.1 time: 0.153431 Oct 28 08:42:02.331821 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 221/439] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:02 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:02.865473 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-39e01a73-a4ae-4300-a7a1-958db2718191 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:02.866533 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-39e01a73-a4ae-4300-a7a1-958db2718191 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:02.872864 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39e01a73-a4ae-4300-a7a1-958db2718191 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:02.873308 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39e01a73-a4ae-4300-a7a1-958db2718191 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:02.874081 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39e01a73-a4ae-4300-a7a1-958db2718191 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:02.874672 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39e01a73-a4ae-4300-a7a1-958db2718191 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:04.334661 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-da01c175-bdbd-4028-859e-2dd9ea074ed5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 3.015491 Oct 28 08:42:04.335306 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 219/440] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:01 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 3017 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:42:04.340372 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1433f091-a9cd-454e-9f6a-e43648e1f67a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:04.341073 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1433f091-a9cd-454e-9f6a-e43648e1f67a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:04.341740 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-39e01a73-a4ae-4300-a7a1-958db2718191 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 1.479928 Oct 28 08:42:04.342375 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 222/441] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:02 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:42:04.348533 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1433f091-a9cd-454e-9f6a-e43648e1f67a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:04.348903 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1433f091-a9cd-454e-9f6a-e43648e1f67a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:04.349025 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6967a264-f7ed-4fa0-959f-039dd0d7d03c tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:04.349592 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6967a264-f7ed-4fa0-959f-039dd0d7d03c tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:04.349697 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1433f091-a9cd-454e-9f6a-e43648e1f67a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:04.350088 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1433f091-a9cd-454e-9f6a-e43648e1f67a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:04.360792 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6967a264-f7ed-4fa0-959f-039dd0d7d03c tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:04.361240 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6967a264-f7ed-4fa0-959f-039dd0d7d03c tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:04.362021 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6967a264-f7ed-4fa0-959f-039dd0d7d03c tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:04.362444 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6967a264-f7ed-4fa0-959f-039dd0d7d03c tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:04.866447 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1433f091-a9cd-454e-9f6a-e43648e1f67a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:04.873267 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-6967a264-f7ed-4fa0-959f-039dd0d7d03c tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:04.875117 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1433f091-a9cd-454e-9f6a-e43648e1f67a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1521 microversion: 2.1 time: 0.537720 Oct 28 08:42:04.875757 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 220/442] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:04 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1521 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:04.880512 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8781ad28-3587-4767-ad96-2d7780807c7b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:04.881108 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8781ad28-3587-4767-ad96-2d7780807c7b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:04.886842 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8781ad28-3587-4767-ad96-2d7780807c7b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:04.887289 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8781ad28-3587-4767-ad96-2d7780807c7b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:04.888030 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6967a264-f7ed-4fa0-959f-039dd0d7d03c tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1313 microversion: 2.1 time: 0.544416 Oct 28 08:42:04.888152 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8781ad28-3587-4767-ad96-2d7780807c7b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:04.888482 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8781ad28-3587-4767-ad96-2d7780807c7b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:04.889125 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 223/443] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:04 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1313 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:05.016777 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-8781ad28-3587-4767-ad96-2d7780807c7b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:05.023881 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8781ad28-3587-4767-ad96-2d7780807c7b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1318 microversion: 2.1 time: 0.147174 Oct 28 08:42:05.024445 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 221/444] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:04 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:05.346726 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9b683c1c-8f22-44eb-b073-20d788718add tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:05.347640 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9b683c1c-8f22-44eb-b073-20d788718add tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:05.353998 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9b683c1c-8f22-44eb-b073-20d788718add tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:05.354446 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9b683c1c-8f22-44eb-b073-20d788718add tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:05.355297 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9b683c1c-8f22-44eb-b073-20d788718add tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:05.355709 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4e3bba61-6b92-47e8-bd66-437383f63824 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:05.356416 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9b683c1c-8f22-44eb-b073-20d788718add tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:05.357033 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4e3bba61-6b92-47e8-bd66-437383f63824 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:05.363390 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e3bba61-6b92-47e8-bd66-437383f63824 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:05.363832 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e3bba61-6b92-47e8-bd66-437383f63824 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:05.364597 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e3bba61-6b92-47e8-bd66-437383f63824 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:05.365029 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e3bba61-6b92-47e8-bd66-437383f63824 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:05.462016 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4e3bba61-6b92-47e8-bd66-437383f63824 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 0.110464 Oct 28 08:42:05.465707 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 222/445] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:05 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:42:05.465846 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9b683c1c-8f22-44eb-b073-20d788718add tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 0.122129 Oct 28 08:42:05.465846 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 224/446] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:05 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:05.892911 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2dd46815-9d69-4816-8c2a-1170746da2b5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:05.893501 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2dd46815-9d69-4816-8c2a-1170746da2b5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:05.900565 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2dd46815-9d69-4816-8c2a-1170746da2b5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:05.901004 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2dd46815-9d69-4816-8c2a-1170746da2b5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:05.901764 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2dd46815-9d69-4816-8c2a-1170746da2b5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:05.902185 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2dd46815-9d69-4816-8c2a-1170746da2b5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:05.905655 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b14fcec6-24fb-4255-ba96-9d0a14d0d3a2 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:05.906340 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b14fcec6-24fb-4255-ba96-9d0a14d0d3a2 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:05.913328 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b14fcec6-24fb-4255-ba96-9d0a14d0d3a2 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:05.913825 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b14fcec6-24fb-4255-ba96-9d0a14d0d3a2 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:05.914773 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b14fcec6-24fb-4255-ba96-9d0a14d0d3a2 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:05.915127 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b14fcec6-24fb-4255-ba96-9d0a14d0d3a2 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:06.094693 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-2dd46815-9d69-4816-8c2a-1170746da2b5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:06.099740 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-b14fcec6-24fb-4255-ba96-9d0a14d0d3a2 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:06.102717 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2dd46815-9d69-4816-8c2a-1170746da2b5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1501 microversion: 2.1 time: 0.214453 Oct 28 08:42:06.103805 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 223/447] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:05 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1501 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:06.108260 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0b403382-bd8e-45d0-abee-7b6a9cfd7062 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:06.110083 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0b403382-bd8e-45d0-abee-7b6a9cfd7062 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:06.112233 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b14fcec6-24fb-4255-ba96-9d0a14d0d3a2 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1313 microversion: 2.1 time: 0.210480 Oct 28 08:42:06.113135 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 225/448] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:05 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:06.117055 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b403382-bd8e-45d0-abee-7b6a9cfd7062 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:06.117497 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b403382-bd8e-45d0-abee-7b6a9cfd7062 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:06.118296 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b403382-bd8e-45d0-abee-7b6a9cfd7062 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:06.118763 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b403382-bd8e-45d0-abee-7b6a9cfd7062 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:06.120592 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1e55e85c-508d-43e7-8db9-fdd5cc6ca630 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:06.121181 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1e55e85c-508d-43e7-8db9-fdd5cc6ca630 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:06.127398 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e55e85c-508d-43e7-8db9-fdd5cc6ca630 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:06.127898 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e55e85c-508d-43e7-8db9-fdd5cc6ca630 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:06.128685 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e55e85c-508d-43e7-8db9-fdd5cc6ca630 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:06.129121 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e55e85c-508d-43e7-8db9-fdd5cc6ca630 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:06.304689 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-0b403382-bd8e-45d0-abee-7b6a9cfd7062 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:06.309507 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-1e55e85c-508d-43e7-8db9-fdd5cc6ca630 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:06.312975 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0b403382-bd8e-45d0-abee-7b6a9cfd7062 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1318 microversion: 2.1 time: 0.207438 Oct 28 08:42:06.313564 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 224/449] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:06 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:06.316994 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1e55e85c-508d-43e7-8db9-fdd5cc6ca630 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1516 microversion: 2.1 time: 0.199771 Oct 28 08:42:06.317549 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 226/450] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:06 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1516 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:06.475512 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e93125fc-44c9-4480-804f-1c496e2a6eb6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:06.476815 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e93125fc-44c9-4480-804f-1c496e2a6eb6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:06.478985 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5fcb08bc-8ffb-4f5d-bf84-ea12409c34a2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:06.480042 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5fcb08bc-8ffb-4f5d-bf84-ea12409c34a2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:06.483777 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e93125fc-44c9-4480-804f-1c496e2a6eb6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:06.484922 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e93125fc-44c9-4480-804f-1c496e2a6eb6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:06.485717 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e93125fc-44c9-4480-804f-1c496e2a6eb6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:06.486134 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e93125fc-44c9-4480-804f-1c496e2a6eb6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:06.487773 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fcb08bc-8ffb-4f5d-bf84-ea12409c34a2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:06.488391 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fcb08bc-8ffb-4f5d-bf84-ea12409c34a2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:06.489166 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fcb08bc-8ffb-4f5d-bf84-ea12409c34a2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:06.489590 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fcb08bc-8ffb-4f5d-bf84-ea12409c34a2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:06.570200 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5fcb08bc-8ffb-4f5d-bf84-ea12409c34a2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 0.096325 Oct 28 08:42:06.570943 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 227/451] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:06 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:06.613266 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e93125fc-44c9-4480-804f-1c496e2a6eb6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 0.141789 Oct 28 08:42:06.614151 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 225/452] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:06 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:07.129799 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-44255cc2-6e9a-46d4-9077-f70fb2e3257f tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:07.130538 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-44255cc2-6e9a-46d4-9077-f70fb2e3257f tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:07.137541 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44255cc2-6e9a-46d4-9077-f70fb2e3257f tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:07.137983 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44255cc2-6e9a-46d4-9077-f70fb2e3257f tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:07.138799 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44255cc2-6e9a-46d4-9077-f70fb2e3257f tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:07.139230 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44255cc2-6e9a-46d4-9077-f70fb2e3257f tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:07.266260 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-44255cc2-6e9a-46d4-9077-f70fb2e3257f tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:07.274001 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-44255cc2-6e9a-46d4-9077-f70fb2e3257f tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1313 microversion: 2.1 time: 0.148160 Oct 28 08:42:07.274598 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 228/453] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:07 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:07.330077 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-113de46e-9b10-4162-86bd-698754897e38 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:07.330802 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-113de46e-9b10-4162-86bd-698754897e38 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:07.337878 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-113de46e-9b10-4162-86bd-698754897e38 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:07.338328 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-113de46e-9b10-4162-86bd-698754897e38 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:07.339123 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-113de46e-9b10-4162-86bd-698754897e38 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:07.339552 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-113de46e-9b10-4162-86bd-698754897e38 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:07.477198 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-113de46e-9b10-4162-86bd-698754897e38 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:07.485554 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-113de46e-9b10-4162-86bd-698754897e38 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1318 microversion: 2.1 time: 0.159855 Oct 28 08:42:07.486117 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 226/454] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:07 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:07.581198 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f0fb988b-291d-4035-b40a-c326f6934c6f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:07.582117 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f0fb988b-291d-4035-b40a-c326f6934c6f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:07.588265 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0fb988b-291d-4035-b40a-c326f6934c6f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:07.588702 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0fb988b-291d-4035-b40a-c326f6934c6f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:07.589458 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0fb988b-291d-4035-b40a-c326f6934c6f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:07.589885 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0fb988b-291d-4035-b40a-c326f6934c6f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:07.625909 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2fc58a72-06df-459d-9383-7f6b1507d2b9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:07.626323 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2fc58a72-06df-459d-9383-7f6b1507d2b9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:07.632636 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2fc58a72-06df-459d-9383-7f6b1507d2b9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:07.633096 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2fc58a72-06df-459d-9383-7f6b1507d2b9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:07.633850 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2fc58a72-06df-459d-9383-7f6b1507d2b9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:07.634282 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2fc58a72-06df-459d-9383-7f6b1507d2b9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:07.668909 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f0fb988b-291d-4035-b40a-c326f6934c6f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 0.091301 Oct 28 08:42:07.669561 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 229/455] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:07 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:07.712643 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2fc58a72-06df-459d-9383-7f6b1507d2b9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 0.091268 Oct 28 08:42:07.713475 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 227/456] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:07 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:42:08.264001 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-60616627-ad44-4dc3-b1ca-dbb36dc406f2 req-9599c991-80cd-47ad-877f-4ffdf1adfd27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3", "name": "network-vif-plugged", "status": "completed", "tag": "9be23939-416b-4e30-86a9-026576b06e86"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:08.266171 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:42:08.266171 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:42:08.274430 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-60616627-ad44-4dc3-b1ca-dbb36dc406f2 req-9599c991-80cd-47ad-877f-4ffdf1adfd27 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:08.275045 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-60616627-ad44-4dc3-b1ca-dbb36dc406f2 req-9599c991-80cd-47ad-877f-4ffdf1adfd27 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:08.287662 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-60616627-ad44-4dc3-b1ca-dbb36dc406f2 req-9599c991-80cd-47ad-877f-4ffdf1adfd27 service nova] Creating event network-vif-plugged:9be23939-416b-4e30-86a9-026576b06e86 for instance 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 on hv-cinder-81565 Oct 28 08:42:08.292669 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-60616627-ad44-4dc3-b1ca-dbb36dc406f2 req-9599c991-80cd-47ad-877f-4ffdf1adfd27 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032335 Oct 28 08:42:08.293647 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 230/457] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:42:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:42:08.294825 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-56c20a6e-ed2d-4719-8752-3dec7f5cd895 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:08.295616 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-56c20a6e-ed2d-4719-8752-3dec7f5cd895 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:08.304021 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56c20a6e-ed2d-4719-8752-3dec7f5cd895 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:08.304468 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56c20a6e-ed2d-4719-8752-3dec7f5cd895 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:08.305232 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56c20a6e-ed2d-4719-8752-3dec7f5cd895 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:08.305838 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56c20a6e-ed2d-4719-8752-3dec7f5cd895 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:08.430263 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-56c20a6e-ed2d-4719-8752-3dec7f5cd895 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:08.439338 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-56c20a6e-ed2d-4719-8752-3dec7f5cd895 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1313 microversion: 2.1 time: 0.149640 Oct 28 08:42:08.439912 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 228/458] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:08 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:08.502734 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9ee6106c-6794-460e-b1fa-7a96ab97069d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:08.503334 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9ee6106c-6794-460e-b1fa-7a96ab97069d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:08.509309 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ee6106c-6794-460e-b1fa-7a96ab97069d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:08.509741 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ee6106c-6794-460e-b1fa-7a96ab97069d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:08.510489 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ee6106c-6794-460e-b1fa-7a96ab97069d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:08.510937 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ee6106c-6794-460e-b1fa-7a96ab97069d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:08.630940 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-9ee6106c-6794-460e-b1fa-7a96ab97069d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:08.638230 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9ee6106c-6794-460e-b1fa-7a96ab97069d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1318 microversion: 2.1 time: 0.140587 Oct 28 08:42:08.638815 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 231/459] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:08 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:08.680770 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4bec6362-e221-49ec-a7c1-2b3c18934b73 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:08.681901 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4bec6362-e221-49ec-a7c1-2b3c18934b73 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:08.688617 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4bec6362-e221-49ec-a7c1-2b3c18934b73 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:08.689061 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4bec6362-e221-49ec-a7c1-2b3c18934b73 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:08.689827 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4bec6362-e221-49ec-a7c1-2b3c18934b73 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:08.690262 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4bec6362-e221-49ec-a7c1-2b3c18934b73 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:08.716468 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-247570c6-4678-469f-9117-8e742218bbac tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:08.717667 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-247570c6-4678-469f-9117-8e742218bbac tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:08.725083 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-247570c6-4678-469f-9117-8e742218bbac tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:08.725525 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-247570c6-4678-469f-9117-8e742218bbac tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:08.726274 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-247570c6-4678-469f-9117-8e742218bbac tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:08.726726 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-247570c6-4678-469f-9117-8e742218bbac tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:08.749908 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-247570c6-4678-469f-9117-8e742218bbac tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lazy-loading 'flavor' on Instance uuid a432ca47-c48c-4e08-8b76-0025d9ef360b {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:42:08.819379 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-247570c6-4678-469f-9117-8e742218bbac tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "POST /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b/action" status: 200 len: 32 microversion: 2.1 time: 0.106575 Oct 28 08:42:08.819988 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 232/460] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:08 2021] POST /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b/action => generated 32 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 08:42:08.824846 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-850c5d2c-1bcd-489c-a02b-a140bae474a1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:08.825820 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-850c5d2c-1bcd-489c-a02b-a140bae474a1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:08.832203 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-850c5d2c-1bcd-489c-a02b-a140bae474a1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:08.832639 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-850c5d2c-1bcd-489c-a02b-a140bae474a1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:08.833391 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-850c5d2c-1bcd-489c-a02b-a140bae474a1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:08.833811 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-850c5d2c-1bcd-489c-a02b-a140bae474a1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:12.620073 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4bec6362-e221-49ec-a7c1-2b3c18934b73 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 3.942726 Oct 28 08:42:12.620720 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 229/461] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:08 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 3944 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:12.625776 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-523a959d-9721-4c2b-a7a4-68b99396d77f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:12.626461 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-523a959d-9721-4c2b-a7a4-68b99396d77f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:12.633373 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-523a959d-9721-4c2b-a7a4-68b99396d77f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:12.633817 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-523a959d-9721-4c2b-a7a4-68b99396d77f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:12.634614 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-523a959d-9721-4c2b-a7a4-68b99396d77f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:12.635334 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-523a959d-9721-4c2b-a7a4-68b99396d77f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:12.635671 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-850c5d2c-1bcd-489c-a02b-a140bae474a1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 3.814317 Oct 28 08:42:12.637944 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 233/462] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:08 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 3817 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:12.643880 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7a5f5473-0426-42ec-a97d-254728244d43 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:12.644987 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7a5f5473-0426-42ec-a97d-254728244d43 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:12.652237 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a5f5473-0426-42ec-a97d-254728244d43 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:12.652696 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a5f5473-0426-42ec-a97d-254728244d43 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:12.653452 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a5f5473-0426-42ec-a97d-254728244d43 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:12.653877 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a5f5473-0426-42ec-a97d-254728244d43 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:12.962517 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-7a5f5473-0426-42ec-a97d-254728244d43 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:12.969830 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7a5f5473-0426-42ec-a97d-254728244d43 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1313 microversion: 2.1 time: 0.330501 Oct 28 08:42:12.970401 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 234/463] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:12 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:12.974658 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-523a959d-9721-4c2b-a7a4-68b99396d77f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:12.982007 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-684a8757-47e2-400f-b808-4d0457de4ede tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:12.982739 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-684a8757-47e2-400f-b808-4d0457de4ede tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:12.982900 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-523a959d-9721-4c2b-a7a4-68b99396d77f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1522 microversion: 2.1 time: 0.360656 Oct 28 08:42:12.983511 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 230/464] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:12 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:12.997623 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-684a8757-47e2-400f-b808-4d0457de4ede tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:12.998062 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-684a8757-47e2-400f-b808-4d0457de4ede tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:12.998907 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-684a8757-47e2-400f-b808-4d0457de4ede tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:12.999367 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-684a8757-47e2-400f-b808-4d0457de4ede tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:13.121991 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-684a8757-47e2-400f-b808-4d0457de4ede tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:13.129917 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-684a8757-47e2-400f-b808-4d0457de4ede tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1318 microversion: 2.1 time: 0.158555 Oct 28 08:42:13.130641 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 235/465] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:12 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:13.631560 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fe724f43-07fd-42e2-8584-fd77bb0f94ac tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:13.632456 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fe724f43-07fd-42e2-8584-fd77bb0f94ac tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:13.639731 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe724f43-07fd-42e2-8584-fd77bb0f94ac tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:13.640170 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe724f43-07fd-42e2-8584-fd77bb0f94ac tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:13.641577 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe724f43-07fd-42e2-8584-fd77bb0f94ac tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:13.642026 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe724f43-07fd-42e2-8584-fd77bb0f94ac tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:13.649655 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e3d2e742-2b84-420b-b3ee-f7ebe5ef7e82 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:13.650561 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e3d2e742-2b84-420b-b3ee-f7ebe5ef7e82 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:13.657741 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3d2e742-2b84-420b-b3ee-f7ebe5ef7e82 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:13.658199 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3d2e742-2b84-420b-b3ee-f7ebe5ef7e82 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:13.658998 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3d2e742-2b84-420b-b3ee-f7ebe5ef7e82 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:13.659610 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3d2e742-2b84-420b-b3ee-f7ebe5ef7e82 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:14.238248 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e3d2e742-2b84-420b-b3ee-f7ebe5ef7e82 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 0.592169 Oct 28 08:42:14.239547 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 236/466] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:13 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:14.242715 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fe724f43-07fd-42e2-8584-fd77bb0f94ac tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 0.612805 Oct 28 08:42:14.245215 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 231/467] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:13 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:14.246879 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fc1b5dee-e4e4-429c-8b4b-c093594160ac tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:14.247654 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fc1b5dee-e4e4-429c-8b4b-c093594160ac tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:14.250234 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d38e5c4a-4767-4acd-be6d-e296bb5101b7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:14.251004 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d38e5c4a-4767-4acd-be6d-e296bb5101b7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:14.261907 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc1b5dee-e4e4-429c-8b4b-c093594160ac tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:14.262352 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc1b5dee-e4e4-429c-8b4b-c093594160ac tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:14.263214 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc1b5dee-e4e4-429c-8b4b-c093594160ac tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:14.263630 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc1b5dee-e4e4-429c-8b4b-c093594160ac tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:14.265055 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d38e5c4a-4767-4acd-be6d-e296bb5101b7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:14.265534 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d38e5c4a-4767-4acd-be6d-e296bb5101b7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:14.266531 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d38e5c4a-4767-4acd-be6d-e296bb5101b7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:14.266868 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d38e5c4a-4767-4acd-be6d-e296bb5101b7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:14.514668 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-fc1b5dee-e4e4-429c-8b4b-c093594160ac tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:14.522165 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-d38e5c4a-4767-4acd-be6d-e296bb5101b7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:14.522596 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fc1b5dee-e4e4-429c-8b4b-c093594160ac tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1313 microversion: 2.1 time: 0.282458 Oct 28 08:42:14.523247 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 237/468] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:14 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:14.527527 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8965f0f3-ca0d-45fc-befc-79482df77779 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:14.528200 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8965f0f3-ca0d-45fc-befc-79482df77779 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:14.534414 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d38e5c4a-4767-4acd-be6d-e296bb5101b7 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1522 microversion: 2.1 time: 0.287993 Oct 28 08:42:14.534833 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8965f0f3-ca0d-45fc-befc-79482df77779 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:14.534962 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 232/469] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:14 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:14.535275 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8965f0f3-ca0d-45fc-befc-79482df77779 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:14.536037 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8965f0f3-ca0d-45fc-befc-79482df77779 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:14.536471 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8965f0f3-ca0d-45fc-befc-79482df77779 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:14.657918 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-8965f0f3-ca0d-45fc-befc-79482df77779 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:14.665227 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8965f0f3-ca0d-45fc-befc-79482df77779 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1318 microversion: 2.1 time: 0.140944 Oct 28 08:42:14.665786 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 238/470] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:14 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:15.252667 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-daad7d6a-e139-4418-8e0b-9e0a1b1bec70 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:15.253246 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-093afdef-7bab-4dde-acfd-e9ac9c2ae4bc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:15.253643 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-daad7d6a-e139-4418-8e0b-9e0a1b1bec70 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:15.253955 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-093afdef-7bab-4dde-acfd-e9ac9c2ae4bc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:15.260248 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-daad7d6a-e139-4418-8e0b-9e0a1b1bec70 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:15.260439 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-093afdef-7bab-4dde-acfd-e9ac9c2ae4bc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:15.260695 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-daad7d6a-e139-4418-8e0b-9e0a1b1bec70 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:15.260802 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-093afdef-7bab-4dde-acfd-e9ac9c2ae4bc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:15.261464 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-daad7d6a-e139-4418-8e0b-9e0a1b1bec70 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:15.261570 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-093afdef-7bab-4dde-acfd-e9ac9c2ae4bc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:15.261895 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-daad7d6a-e139-4418-8e0b-9e0a1b1bec70 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:15.262003 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-093afdef-7bab-4dde-acfd-e9ac9c2ae4bc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:19.716962 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-daad7d6a-e139-4418-8e0b-9e0a1b1bec70 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 4.468840 Oct 28 08:42:19.717877 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 233/471] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:15 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 4471 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:42:19.724032 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2aa9be1d-8045-41ae-8846-a9273cd239cf tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:19.724704 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2aa9be1d-8045-41ae-8846-a9273cd239cf tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:19.731420 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2aa9be1d-8045-41ae-8846-a9273cd239cf tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:19.731849 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2aa9be1d-8045-41ae-8846-a9273cd239cf tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:19.732609 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2aa9be1d-8045-41ae-8846-a9273cd239cf tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:19.733026 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2aa9be1d-8045-41ae-8846-a9273cd239cf tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:19.733876 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-093afdef-7bab-4dde-acfd-e9ac9c2ae4bc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 4.484712 Oct 28 08:42:19.736444 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 239/472] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:15 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 4488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:42:19.742043 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ff3f8da0-8663-47da-93d4-9d8fa668197d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:19.742866 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ff3f8da0-8663-47da-93d4-9d8fa668197d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:19.749882 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff3f8da0-8663-47da-93d4-9d8fa668197d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:19.750371 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff3f8da0-8663-47da-93d4-9d8fa668197d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:19.751189 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff3f8da0-8663-47da-93d4-9d8fa668197d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:19.751618 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff3f8da0-8663-47da-93d4-9d8fa668197d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:19.928548 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-ff3f8da0-8663-47da-93d4-9d8fa668197d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:19.931720 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-2aa9be1d-8045-41ae-8846-a9273cd239cf tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:19.936285 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ff3f8da0-8663-47da-93d4-9d8fa668197d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1522 microversion: 2.1 time: 0.198768 Oct 28 08:42:19.937047 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 240/473] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:19 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:19.941763 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a60579bf-15a1-4314-9662-5425af9ef869 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:19.942354 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a60579bf-15a1-4314-9662-5425af9ef869 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:19.946268 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2aa9be1d-8045-41ae-8846-a9273cd239cf tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1313 microversion: 2.1 time: 0.225987 Oct 28 08:42:19.947249 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 234/474] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:19 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:19.948857 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a60579bf-15a1-4314-9662-5425af9ef869 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:19.949296 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a60579bf-15a1-4314-9662-5425af9ef869 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:19.950059 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a60579bf-15a1-4314-9662-5425af9ef869 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:19.950478 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a60579bf-15a1-4314-9662-5425af9ef869 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:20.077328 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-a60579bf-15a1-4314-9662-5425af9ef869 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:20.085729 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a60579bf-15a1-4314-9662-5425af9ef869 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1318 microversion: 2.1 time: 0.147891 Oct 28 08:42:20.086531 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 241/475] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:19 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:20.729561 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-28e64d58-0f1c-4b0e-8374-5235e2fce76f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:20.730396 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-28e64d58-0f1c-4b0e-8374-5235e2fce76f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:20.737248 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28e64d58-0f1c-4b0e-8374-5235e2fce76f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:20.737681 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28e64d58-0f1c-4b0e-8374-5235e2fce76f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:20.738431 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28e64d58-0f1c-4b0e-8374-5235e2fce76f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:20.738881 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28e64d58-0f1c-4b0e-8374-5235e2fce76f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:20.746515 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e8d1df6e-3ea7-4c70-8f4c-8fedfa3900fc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:20.747510 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e8d1df6e-3ea7-4c70-8f4c-8fedfa3900fc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:20.754572 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8d1df6e-3ea7-4c70-8f4c-8fedfa3900fc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:20.755017 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8d1df6e-3ea7-4c70-8f4c-8fedfa3900fc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:20.755788 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8d1df6e-3ea7-4c70-8f4c-8fedfa3900fc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:20.756219 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8d1df6e-3ea7-4c70-8f4c-8fedfa3900fc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:22.969398 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-28e64d58-0f1c-4b0e-8374-5235e2fce76f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 2.242812 Oct 28 08:42:22.970082 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 235/476] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:20 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 2245 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:22.975436 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9917515c-dfa0-4854-84a7-44f207ad7b94 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:22.976151 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9917515c-dfa0-4854-84a7-44f207ad7b94 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:22.983016 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9917515c-dfa0-4854-84a7-44f207ad7b94 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:22.983463 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9917515c-dfa0-4854-84a7-44f207ad7b94 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:22.984261 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9917515c-dfa0-4854-84a7-44f207ad7b94 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:22.984692 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9917515c-dfa0-4854-84a7-44f207ad7b94 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:23.112930 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-9917515c-dfa0-4854-84a7-44f207ad7b94 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:23.121045 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9917515c-dfa0-4854-84a7-44f207ad7b94 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1522 microversion: 2.1 time: 0.149751 Oct 28 08:42:23.121609 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 236/477] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:22 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:23.126856 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7aecdd3e-87fb-40b8-8313-104f9aedd790 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:23.127462 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7aecdd3e-87fb-40b8-8313-104f9aedd790 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:23.134038 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7aecdd3e-87fb-40b8-8313-104f9aedd790 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:23.134479 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7aecdd3e-87fb-40b8-8313-104f9aedd790 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:23.135374 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7aecdd3e-87fb-40b8-8313-104f9aedd790 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:23.135806 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7aecdd3e-87fb-40b8-8313-104f9aedd790 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:23.266849 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-7aecdd3e-87fb-40b8-8313-104f9aedd790 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:23.274034 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7aecdd3e-87fb-40b8-8313-104f9aedd790 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1313 microversion: 2.1 time: 0.151496 Oct 28 08:42:23.274642 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 237/478] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:23 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:23.278802 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-49997479-2116-4308-a62f-4f00751aeda2 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:23.279385 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-49997479-2116-4308-a62f-4f00751aeda2 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:23.285200 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49997479-2116-4308-a62f-4f00751aeda2 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:23.285644 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49997479-2116-4308-a62f-4f00751aeda2 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:23.286412 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49997479-2116-4308-a62f-4f00751aeda2 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:23.286921 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49997479-2116-4308-a62f-4f00751aeda2 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:23.408586 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-49997479-2116-4308-a62f-4f00751aeda2 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:23.416130 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-49997479-2116-4308-a62f-4f00751aeda2 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1318 microversion: 2.1 time: 0.140490 Oct 28 08:42:23.416711 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 238/479] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:23 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:23.421190 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-41f317bb-3162-4b88-82ea-c0d52fae8dc7 req-4fd05463-597b-4398-92e2-e475abe75cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "174ae5e4-f21b-4141-88bf-98e7d5efb161", "name": "network-vif-plugged", "status": "completed", "tag": "959d849c-17d9-4e15-b426-749af75d8b93"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:23.423333 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:42:23.423333 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:42:23.430333 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-41f317bb-3162-4b88-82ea-c0d52fae8dc7 req-4fd05463-597b-4398-92e2-e475abe75cd0 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:23.430783 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-41f317bb-3162-4b88-82ea-c0d52fae8dc7 req-4fd05463-597b-4398-92e2-e475abe75cd0 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:23.442017 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-41f317bb-3162-4b88-82ea-c0d52fae8dc7 req-4fd05463-597b-4398-92e2-e475abe75cd0 service nova] Creating event network-vif-plugged:959d849c-17d9-4e15-b426-749af75d8b93 for instance 174ae5e4-f21b-4141-88bf-98e7d5efb161 on hv-cinder-81565 Oct 28 08:42:23.446845 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-41f317bb-3162-4b88-82ea-c0d52fae8dc7 req-4fd05463-597b-4398-92e2-e475abe75cd0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029018 Oct 28 08:42:23.447419 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 239/480] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:42:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:42:23.981784 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6dfccb9e-4098-4340-baae-e5227ecea880 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:23.982796 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6dfccb9e-4098-4340-baae-e5227ecea880 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:23.990089 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6dfccb9e-4098-4340-baae-e5227ecea880 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:23.990546 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6dfccb9e-4098-4340-baae-e5227ecea880 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:23.991296 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6dfccb9e-4098-4340-baae-e5227ecea880 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:23.991719 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6dfccb9e-4098-4340-baae-e5227ecea880 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:25.686666 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e8d1df6e-3ea7-4c70-8f4c-8fedfa3900fc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 4.943559 Oct 28 08:42:25.687872 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 242/481] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:20 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 4946 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:42:25.692643 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-af2a7dd5-2e3d-42bf-881d-aa8a68500d14 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:25.693317 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-af2a7dd5-2e3d-42bf-881d-aa8a68500d14 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:25.699994 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af2a7dd5-2e3d-42bf-881d-aa8a68500d14 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:25.700429 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af2a7dd5-2e3d-42bf-881d-aa8a68500d14 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:25.701183 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af2a7dd5-2e3d-42bf-881d-aa8a68500d14 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:25.701603 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af2a7dd5-2e3d-42bf-881d-aa8a68500d14 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:25.773939 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6dfccb9e-4098-4340-baae-e5227ecea880 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 1.796278 Oct 28 08:42:25.774773 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 240/482] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:23 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:42:25.779829 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-74861f23-5643-4168-9502-33404b2b0f9e tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:25.780672 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-74861f23-5643-4168-9502-33404b2b0f9e tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:25.788686 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74861f23-5643-4168-9502-33404b2b0f9e tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:25.789224 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74861f23-5643-4168-9502-33404b2b0f9e tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:25.790229 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74861f23-5643-4168-9502-33404b2b0f9e tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:25.790595 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74861f23-5643-4168-9502-33404b2b0f9e tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:25.850764 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-af2a7dd5-2e3d-42bf-881d-aa8a68500d14 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:25.858879 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-af2a7dd5-2e3d-42bf-881d-aa8a68500d14 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1522 microversion: 2.1 time: 0.169759 Oct 28 08:42:25.866272 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 243/483] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:25 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:25.876491 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f89fa489-a3e0-4d6d-a17a-fb0481734fc6 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:25.877414 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f89fa489-a3e0-4d6d-a17a-fb0481734fc6 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:25.884392 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f89fa489-a3e0-4d6d-a17a-fb0481734fc6 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:25.885097 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f89fa489-a3e0-4d6d-a17a-fb0481734fc6 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:25.886024 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f89fa489-a3e0-4d6d-a17a-fb0481734fc6 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:25.886780 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f89fa489-a3e0-4d6d-a17a-fb0481734fc6 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:26.012079 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-74861f23-5643-4168-9502-33404b2b0f9e tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:26.020118 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-74861f23-5643-4168-9502-33404b2b0f9e tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1313 microversion: 2.1 time: 0.244167 Oct 28 08:42:26.020695 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 241/484] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:25 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:26.092506 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-f89fa489-a3e0-4d6d-a17a-fb0481734fc6 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:26.100851 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f89fa489-a3e0-4d6d-a17a-fb0481734fc6 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1318 microversion: 2.1 time: 0.233085 Oct 28 08:42:26.101425 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 244/485] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:25 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:26.699695 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ea5676aa-0c7e-42c0-80cd-b1ef00e57c7c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:26.700713 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ea5676aa-0c7e-42c0-80cd-b1ef00e57c7c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:26.707095 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea5676aa-0c7e-42c0-80cd-b1ef00e57c7c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:26.707532 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea5676aa-0c7e-42c0-80cd-b1ef00e57c7c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:26.708292 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea5676aa-0c7e-42c0-80cd-b1ef00e57c7c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:26.708714 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea5676aa-0c7e-42c0-80cd-b1ef00e57c7c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:26.785622 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-61de3e72-b806-4efa-a2bd-ec366e9bfc95 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:26.786520 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-61de3e72-b806-4efa-a2bd-ec366e9bfc95 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:26.792745 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61de3e72-b806-4efa-a2bd-ec366e9bfc95 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:26.793094 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61de3e72-b806-4efa-a2bd-ec366e9bfc95 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:26.793850 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61de3e72-b806-4efa-a2bd-ec366e9bfc95 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:26.794270 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61de3e72-b806-4efa-a2bd-ec366e9bfc95 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:26.794872 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ea5676aa-0c7e-42c0-80cd-b1ef00e57c7c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 0.098934 Oct 28 08:42:26.798759 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 242/486] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:26 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:26.877877 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7b5dbaf5-dfdb-478a-a73c-6445e18c031c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:26.878596 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7b5dbaf5-dfdb-478a-a73c-6445e18c031c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:26.886100 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b5dbaf5-dfdb-478a-a73c-6445e18c031c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:26.886615 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b5dbaf5-dfdb-478a-a73c-6445e18c031c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:26.887521 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b5dbaf5-dfdb-478a-a73c-6445e18c031c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:26.888138 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b5dbaf5-dfdb-478a-a73c-6445e18c031c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:26.890401 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-61de3e72-b806-4efa-a2bd-ec366e9bfc95 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 0.107784 Oct 28 08:42:26.894184 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 245/487] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:26 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:42:27.013799 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-7b5dbaf5-dfdb-478a-a73c-6445e18c031c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:27.021541 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7b5dbaf5-dfdb-478a-a73c-6445e18c031c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1522 microversion: 2.1 time: 0.148872 Oct 28 08:42:27.022111 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 243/488] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:26 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:27.038148 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9d8773c0-6b8d-4223-9bb0-60165d5ffe12 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:27.038927 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9d8773c0-6b8d-4223-9bb0-60165d5ffe12 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:27.046050 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d8773c0-6b8d-4223-9bb0-60165d5ffe12 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:27.046988 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d8773c0-6b8d-4223-9bb0-60165d5ffe12 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:27.047873 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d8773c0-6b8d-4223-9bb0-60165d5ffe12 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:27.048280 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d8773c0-6b8d-4223-9bb0-60165d5ffe12 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:27.116946 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-92414a12-88f4-4146-bc10-1c478db53366 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:27.117550 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-92414a12-88f4-4146-bc10-1c478db53366 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:27.123272 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92414a12-88f4-4146-bc10-1c478db53366 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:27.123711 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92414a12-88f4-4146-bc10-1c478db53366 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:27.124499 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92414a12-88f4-4146-bc10-1c478db53366 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:27.125475 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92414a12-88f4-4146-bc10-1c478db53366 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:27.199538 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-9d8773c0-6b8d-4223-9bb0-60165d5ffe12 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:27.207460 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9d8773c0-6b8d-4223-9bb0-60165d5ffe12 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1496 microversion: 2.1 time: 0.173689 Oct 28 08:42:27.208062 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 246/489] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:27 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1496 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:27.262531 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-92414a12-88f4-4146-bc10-1c478db53366 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:27.270743 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-92414a12-88f4-4146-bc10-1c478db53366 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1318 microversion: 2.1 time: 0.157413 Oct 28 08:42:27.271300 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 244/490] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:27 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:27.712714 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3e61021a-df01-4048-b01a-d78494228541 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:27.713517 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3e61021a-df01-4048-b01a-d78494228541 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:27.727778 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e61021a-df01-4048-b01a-d78494228541 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:27.729811 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e61021a-df01-4048-b01a-d78494228541 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:27.730684 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e61021a-df01-4048-b01a-d78494228541 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:27.731132 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e61021a-df01-4048-b01a-d78494228541 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:27.762717 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3e61021a-df01-4048-b01a-d78494228541 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:42:27.807830 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1260148c-3bc5-48ca-ad70-c1e31f3d0fea tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:27.808910 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1260148c-3bc5-48ca-ad70-c1e31f3d0fea tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:27.817906 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1260148c-3bc5-48ca-ad70-c1e31f3d0fea tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:27.818665 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1260148c-3bc5-48ca-ad70-c1e31f3d0fea tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:27.819716 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1260148c-3bc5-48ca-ad70-c1e31f3d0fea tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:27.820232 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1260148c-3bc5-48ca-ad70-c1e31f3d0fea tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:27.852150 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3e61021a-df01-4048-b01a-d78494228541 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "DELETE /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 204 len: 0 microversion: 2.1 time: 0.142771 Oct 28 08:42:27.853203 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 247/491] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Oct 28 08:42:27 2021] DELETE /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:42:27.861694 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-37cb283b-3a04-43be-9b82-255de6fe9655 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:27.862485 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-37cb283b-3a04-43be-9b82-255de6fe9655 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:27.868800 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37cb283b-3a04-43be-9b82-255de6fe9655 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:27.869308 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37cb283b-3a04-43be-9b82-255de6fe9655 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:27.870344 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37cb283b-3a04-43be-9b82-255de6fe9655 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:27.870844 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37cb283b-3a04-43be-9b82-255de6fe9655 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:27.941984 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1260148c-3bc5-48ca-ad70-c1e31f3d0fea tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 0.138041 Oct 28 08:42:27.949492 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 245/492] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:27 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:42:27.955639 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5a7f3c23-23ac-444c-9a37-83a9d5b035f9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:27.959179 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5a7f3c23-23ac-444c-9a37-83a9d5b035f9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:27.966860 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a7f3c23-23ac-444c-9a37-83a9d5b035f9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:27.967351 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a7f3c23-23ac-444c-9a37-83a9d5b035f9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:27.968111 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a7f3c23-23ac-444c-9a37-83a9d5b035f9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:27.968541 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a7f3c23-23ac-444c-9a37-83a9d5b035f9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:28.010474 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-37cb283b-3a04-43be-9b82-255de6fe9655 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:28.018355 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-37cb283b-3a04-43be-9b82-255de6fe9655 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1502 microversion: 2.1 time: 0.161213 Oct 28 08:42:28.018945 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 248/493] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:27 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:28.037899 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-554742ec-fc65-4810-8b9b-30449e6f1bb6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:28.038527 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-554742ec-fc65-4810-8b9b-30449e6f1bb6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:28.044114 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-554742ec-fc65-4810-8b9b-30449e6f1bb6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:28.044558 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-554742ec-fc65-4810-8b9b-30449e6f1bb6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:28.045308 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-554742ec-fc65-4810-8b9b-30449e6f1bb6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:28.045734 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-554742ec-fc65-4810-8b9b-30449e6f1bb6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:28.081537 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5a7f3c23-23ac-444c-9a37-83a9d5b035f9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 0.130466 Oct 28 08:42:28.082213 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 246/494] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:27 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:28.168819 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-554742ec-fc65-4810-8b9b-30449e6f1bb6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:28.176728 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-554742ec-fc65-4810-8b9b-30449e6f1bb6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1522 microversion: 2.1 time: 0.142205 Oct 28 08:42:28.177291 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 249/495] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:28 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1522 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:28.288103 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-89175dad-7829-446f-8928-d574364b664f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:28.288706 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-89175dad-7829-446f-8928-d574364b664f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:28.295443 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89175dad-7829-446f-8928-d574364b664f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:28.295880 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89175dad-7829-446f-8928-d574364b664f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:28.297279 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89175dad-7829-446f-8928-d574364b664f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:28.297703 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89175dad-7829-446f-8928-d574364b664f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:28.420938 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-89175dad-7829-446f-8928-d574364b664f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:28.429150 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-89175dad-7829-446f-8928-d574364b664f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1318 microversion: 2.1 time: 0.145225 Oct 28 08:42:28.429716 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 247/496] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:28 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:28.953652 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8123e4a0-17d1-4c5b-803a-f896930a5c02 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:28.954761 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8123e4a0-17d1-4c5b-803a-f896930a5c02 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:28.960950 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8123e4a0-17d1-4c5b-803a-f896930a5c02 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:28.961382 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8123e4a0-17d1-4c5b-803a-f896930a5c02 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:28.962143 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8123e4a0-17d1-4c5b-803a-f896930a5c02 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:28.962581 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8123e4a0-17d1-4c5b-803a-f896930a5c02 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:29.037008 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5d1e95ee-7798-47f8-8995-be9d29aace4a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:29.037614 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5d1e95ee-7798-47f8-8995-be9d29aace4a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:29.043991 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d1e95ee-7798-47f8-8995-be9d29aace4a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:29.044440 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d1e95ee-7798-47f8-8995-be9d29aace4a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:29.045206 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d1e95ee-7798-47f8-8995-be9d29aace4a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:29.045635 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d1e95ee-7798-47f8-8995-be9d29aace4a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:29.166923 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-5d1e95ee-7798-47f8-8995-be9d29aace4a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:29.174099 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5d1e95ee-7798-47f8-8995-be9d29aace4a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1502 microversion: 2.1 time: 0.141162 Oct 28 08:42:29.174687 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 248/497] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:29 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1502 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:29.182101 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8d1caf3a-371c-461f-b85b-0abdceec2829 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:29.182101 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8d1caf3a-371c-461f-b85b-0abdceec2829 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:29.185506 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d1caf3a-371c-461f-b85b-0abdceec2829 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:29.185945 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d1caf3a-371c-461f-b85b-0abdceec2829 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:29.186752 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d1caf3a-371c-461f-b85b-0abdceec2829 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:29.187342 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d1caf3a-371c-461f-b85b-0abdceec2829 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:33.359739 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8d1caf3a-371c-461f-b85b-0abdceec2829 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 4.183007 Oct 28 08:42:33.360731 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 249/498] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:29 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 4185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:33.366963 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1026a949-81d1-4821-b12d-10d0879cecec tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:33.367652 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1026a949-81d1-4821-b12d-10d0879cecec tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:33.374919 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1026a949-81d1-4821-b12d-10d0879cecec tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:33.374919 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1026a949-81d1-4821-b12d-10d0879cecec tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:33.375688 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1026a949-81d1-4821-b12d-10d0879cecec tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:33.376116 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1026a949-81d1-4821-b12d-10d0879cecec tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:33.404974 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8123e4a0-17d1-4c5b-803a-f896930a5c02 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 4.455290 Oct 28 08:42:33.409994 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 250/499] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:28 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 4458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:33.411946 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7bb117b6-a9d2-4efb-8499-069fa1d06cdd tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:33.412635 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7bb117b6-a9d2-4efb-8499-069fa1d06cdd tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:33.419767 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bb117b6-a9d2-4efb-8499-069fa1d06cdd tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:33.420212 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bb117b6-a9d2-4efb-8499-069fa1d06cdd tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:33.420984 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bb117b6-a9d2-4efb-8499-069fa1d06cdd tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:33.421413 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bb117b6-a9d2-4efb-8499-069fa1d06cdd tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:33.541108 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1026a949-81d1-4821-b12d-10d0879cecec tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:33.549720 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1026a949-81d1-4821-b12d-10d0879cecec tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1522 microversion: 2.1 time: 0.187516 Oct 28 08:42:33.550779 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 250/500] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:33 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:33.555237 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1a25f07d-569a-46fa-bfb3-0f02841fd1be tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:33.556089 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1a25f07d-569a-46fa-bfb3-0f02841fd1be tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:33.562299 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a25f07d-569a-46fa-bfb3-0f02841fd1be tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:33.562857 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a25f07d-569a-46fa-bfb3-0f02841fd1be tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:33.563697 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a25f07d-569a-46fa-bfb3-0f02841fd1be tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:33.564126 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a25f07d-569a-46fa-bfb3-0f02841fd1be tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:33.595053 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-7bb117b6-a9d2-4efb-8499-069fa1d06cdd tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:33.602648 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7bb117b6-a9d2-4efb-8499-069fa1d06cdd tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1318 microversion: 2.1 time: 0.194416 Oct 28 08:42:33.603214 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 251/501] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:33 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:33.687191 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1a25f07d-569a-46fa-bfb3-0f02841fd1be tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:33.694490 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1a25f07d-569a-46fa-bfb3-0f02841fd1be tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1502 microversion: 2.1 time: 0.142641 Oct 28 08:42:33.695069 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 251/502] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:33 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1502 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:34.372034 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6901bd10-9968-4944-a678-544ab656595c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:34.372909 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6901bd10-9968-4944-a678-544ab656595c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:34.380314 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6901bd10-9968-4944-a678-544ab656595c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:34.380742 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6901bd10-9968-4944-a678-544ab656595c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:34.381486 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6901bd10-9968-4944-a678-544ab656595c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:34.381909 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6901bd10-9968-4944-a678-544ab656595c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:34.417042 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e8e83aa3-c65d-4057-bbd0-3f15ed98cf9f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:34.418007 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e8e83aa3-c65d-4057-bbd0-3f15ed98cf9f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:34.425259 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8e83aa3-c65d-4057-bbd0-3f15ed98cf9f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:34.425696 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8e83aa3-c65d-4057-bbd0-3f15ed98cf9f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:34.426459 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8e83aa3-c65d-4057-bbd0-3f15ed98cf9f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:34.426920 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8e83aa3-c65d-4057-bbd0-3f15ed98cf9f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:34.482103 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6901bd10-9968-4944-a678-544ab656595c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 0.113605 Oct 28 08:42:34.482774 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 252/503] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:34 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:34.550421 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e8e83aa3-c65d-4057-bbd0-3f15ed98cf9f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 0.136821 Oct 28 08:42:34.551107 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 252/504] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:34 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:34.566951 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c0fc36ae-2fe1-4d97-948f-3dd25e75e7f9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:34.567636 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c0fc36ae-2fe1-4d97-948f-3dd25e75e7f9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:34.574412 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0fc36ae-2fe1-4d97-948f-3dd25e75e7f9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:34.574913 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0fc36ae-2fe1-4d97-948f-3dd25e75e7f9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:34.575678 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0fc36ae-2fe1-4d97-948f-3dd25e75e7f9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:34.576109 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0fc36ae-2fe1-4d97-948f-3dd25e75e7f9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:34.619787 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b7740d69-6d2d-433a-87f6-0b7a9513dce5 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:34.620579 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b7740d69-6d2d-433a-87f6-0b7a9513dce5 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:34.627865 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7740d69-6d2d-433a-87f6-0b7a9513dce5 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:34.628213 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7740d69-6d2d-433a-87f6-0b7a9513dce5 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:34.628985 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7740d69-6d2d-433a-87f6-0b7a9513dce5 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:34.629409 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7740d69-6d2d-433a-87f6-0b7a9513dce5 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:34.730476 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c0fc36ae-2fe1-4d97-948f-3dd25e75e7f9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:34.738977 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c0fc36ae-2fe1-4d97-948f-3dd25e75e7f9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1522 microversion: 2.1 time: 0.175963 Oct 28 08:42:34.739547 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 253/505] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:34 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:34.745383 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fbd30233-4128-4585-a359-d71e6bd69489 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:34.745383 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fbd30233-4128-4585-a359-d71e6bd69489 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:34.750556 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbd30233-4128-4585-a359-d71e6bd69489 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:34.751002 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbd30233-4128-4585-a359-d71e6bd69489 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:34.751765 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbd30233-4128-4585-a359-d71e6bd69489 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:34.752193 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbd30233-4128-4585-a359-d71e6bd69489 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:34.790833 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-b7740d69-6d2d-433a-87f6-0b7a9513dce5 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:34.798914 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b7740d69-6d2d-433a-87f6-0b7a9513dce5 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1508 microversion: 2.1 time: 0.183051 Oct 28 08:42:34.799494 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 253/506] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:34 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1508 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:34.878389 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-fbd30233-4128-4585-a359-d71e6bd69489 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:34.885766 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fbd30233-4128-4585-a359-d71e6bd69489 tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1502 microversion: 2.1 time: 0.145246 Oct 28 08:42:34.886340 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 254/507] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:34 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1502 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:35.494531 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-49d54b15-fa7d-43ac-af43-d962c4d2236d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:35.496198 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-49d54b15-fa7d-43ac-af43-d962c4d2236d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:35.503895 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49d54b15-fa7d-43ac-af43-d962c4d2236d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:35.504402 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49d54b15-fa7d-43ac-af43-d962c4d2236d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:35.505180 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49d54b15-fa7d-43ac-af43-d962c4d2236d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:35.505727 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49d54b15-fa7d-43ac-af43-d962c4d2236d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:35.560995 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2e84bafc-36ed-4345-bd23-843a84733e79 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:35.562968 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2e84bafc-36ed-4345-bd23-843a84733e79 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:35.569426 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e84bafc-36ed-4345-bd23-843a84733e79 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:35.570314 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e84bafc-36ed-4345-bd23-843a84733e79 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:35.571018 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e84bafc-36ed-4345-bd23-843a84733e79 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:35.571521 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e84bafc-36ed-4345-bd23-843a84733e79 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:40.137237 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-49d54b15-fa7d-43ac-af43-d962c4d2236d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 4.646125 Oct 28 08:42:40.141191 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 254/508] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:35 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 4648 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:40.143317 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-02a8b9dd-b5e6-455c-97c9-4cb14f617d60 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:40.143986 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-02a8b9dd-b5e6-455c-97c9-4cb14f617d60 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:40.150582 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-02a8b9dd-b5e6-455c-97c9-4cb14f617d60 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:40.151020 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-02a8b9dd-b5e6-455c-97c9-4cb14f617d60 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:40.151757 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-02a8b9dd-b5e6-455c-97c9-4cb14f617d60 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:40.152175 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-02a8b9dd-b5e6-455c-97c9-4cb14f617d60 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:40.159185 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2e84bafc-36ed-4345-bd23-843a84733e79 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 4.601614 Oct 28 08:42:40.163689 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 255/509] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:35 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 4603 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:42:40.165037 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-94f7680c-34e9-43f8-a96f-9bc92f963d3a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:40.165736 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-94f7680c-34e9-43f8-a96f-9bc92f963d3a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:40.173786 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94f7680c-34e9-43f8-a96f-9bc92f963d3a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:40.174232 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94f7680c-34e9-43f8-a96f-9bc92f963d3a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:40.175241 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94f7680c-34e9-43f8-a96f-9bc92f963d3a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:40.175677 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94f7680c-34e9-43f8-a96f-9bc92f963d3a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:40.367687 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-94f7680c-34e9-43f8-a96f-9bc92f963d3a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:40.372567 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-02a8b9dd-b5e6-455c-97c9-4cb14f617d60 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:40.377850 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-94f7680c-34e9-43f8-a96f-9bc92f963d3a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1502 microversion: 2.1 time: 0.216098 Oct 28 08:42:40.378853 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 256/510] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:40 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1502 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:40.380320 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-02a8b9dd-b5e6-455c-97c9-4cb14f617d60 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1522 microversion: 2.1 time: 0.241241 Oct 28 08:42:40.380883 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 255/511] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:40 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:41.148902 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cb1999dd-1b3e-4747-8081-400f25965ef0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:41.149855 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cb1999dd-1b3e-4747-8081-400f25965ef0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:41.156031 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb1999dd-1b3e-4747-8081-400f25965ef0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:41.156476 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb1999dd-1b3e-4747-8081-400f25965ef0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:41.157274 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb1999dd-1b3e-4747-8081-400f25965ef0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:41.157708 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb1999dd-1b3e-4747-8081-400f25965ef0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:41.170584 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b655fb31-b75c-42cf-9b51-1e7d76fc3090 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:41.172205 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b655fb31-b75c-42cf-9b51-1e7d76fc3090 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:41.178582 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b655fb31-b75c-42cf-9b51-1e7d76fc3090 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:41.179027 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b655fb31-b75c-42cf-9b51-1e7d76fc3090 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:41.179792 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b655fb31-b75c-42cf-9b51-1e7d76fc3090 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:41.180218 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b655fb31-b75c-42cf-9b51-1e7d76fc3090 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:41.648398 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b655fb31-b75c-42cf-9b51-1e7d76fc3090 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 0.481209 Oct 28 08:42:41.649072 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 256/512] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:41 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:42:41.654003 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a3205fca-0ad7-43f3-8521-89018cd5286d tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:41.654733 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a3205fca-0ad7-43f3-8521-89018cd5286d tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:41.662119 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a3205fca-0ad7-43f3-8521-89018cd5286d tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:41.662585 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a3205fca-0ad7-43f3-8521-89018cd5286d tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:41.663367 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a3205fca-0ad7-43f3-8521-89018cd5286d tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:41.663798 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a3205fca-0ad7-43f3-8521-89018cd5286d tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:41.693205 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cb1999dd-1b3e-4747-8081-400f25965ef0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 0.547813 Oct 28 08:42:41.693851 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 257/513] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:41 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:41.699433 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-221dd508-4135-4ef5-a36c-e87cdb1374bc tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:41.700116 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-221dd508-4135-4ef5-a36c-e87cdb1374bc tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:41.708581 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-221dd508-4135-4ef5-a36c-e87cdb1374bc tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:41.709013 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-221dd508-4135-4ef5-a36c-e87cdb1374bc tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:41.709776 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-221dd508-4135-4ef5-a36c-e87cdb1374bc tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:41.710205 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-221dd508-4135-4ef5-a36c-e87cdb1374bc tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:41.925405 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-a3205fca-0ad7-43f3-8521-89018cd5286d tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:41.933590 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a3205fca-0ad7-43f3-8521-89018cd5286d tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1502 microversion: 2.1 time: 0.283251 Oct 28 08:42:41.934254 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 257/514] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:41 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1502 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:41.968642 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-221dd508-4135-4ef5-a36c-e87cdb1374bc tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:41.976646 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-221dd508-4135-4ef5-a36c-e87cdb1374bc tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1522 microversion: 2.1 time: 0.280884 Oct 28 08:42:41.977213 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 258/515] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:41 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:42.310350 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-9c926068-1eae-409a-92ce-037c3e83f547 req-cee661d0-ef70-49a4-9dda-75641d71823b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3", "name": "network-vif-deleted", "tag": "9be23939-416b-4e30-86a9-026576b06e86"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:42.312088 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:42:42.312088 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:42:42.320397 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9c926068-1eae-409a-92ce-037c3e83f547 req-cee661d0-ef70-49a4-9dda-75641d71823b service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:42.320849 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9c926068-1eae-409a-92ce-037c3e83f547 req-cee661d0-ef70-49a4-9dda-75641d71823b service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:42.331585 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-9c926068-1eae-409a-92ce-037c3e83f547 req-cee661d0-ef70-49a4-9dda-75641d71823b service nova] Creating event network-vif-deleted:9be23939-416b-4e30-86a9-026576b06e86 for instance 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 on hv-cinder-81565 Oct 28 08:42:42.336878 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-9c926068-1eae-409a-92ce-037c3e83f547 req-cee661d0-ef70-49a4-9dda-75641d71823b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030032 Oct 28 08:42:42.337420 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 258/516] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:42:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:42:42.660864 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-50187cc7-55a0-447e-a706-1b93d4b8870b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:42.661773 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-50187cc7-55a0-447e-a706-1b93d4b8870b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:42.668975 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50187cc7-55a0-447e-a706-1b93d4b8870b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:42.669699 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50187cc7-55a0-447e-a706-1b93d4b8870b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:42.670207 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50187cc7-55a0-447e-a706-1b93d4b8870b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:42.670663 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50187cc7-55a0-447e-a706-1b93d4b8870b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:42.706312 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-00b0ae65-b5ff-46a6-93cd-880dc69a9b34 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:42.707385 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-00b0ae65-b5ff-46a6-93cd-880dc69a9b34 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:42.713345 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00b0ae65-b5ff-46a6-93cd-880dc69a9b34 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:42.713819 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00b0ae65-b5ff-46a6-93cd-880dc69a9b34 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:42.714613 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00b0ae65-b5ff-46a6-93cd-880dc69a9b34 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:42.715040 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00b0ae65-b5ff-46a6-93cd-880dc69a9b34 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:42.761260 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-50187cc7-55a0-447e-a706-1b93d4b8870b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 0.103956 Oct 28 08:42:42.761884 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 259/517] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:42 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:42.837339 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-00b0ae65-b5ff-46a6-93cd-880dc69a9b34 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 0.135801 Oct 28 08:42:42.838790 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 259/518] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:42 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:42:42.953380 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b17da46f-1523-4b4a-bf97-cea2ef33be3c tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:42.954299 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b17da46f-1523-4b4a-bf97-cea2ef33be3c tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:42.961680 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b17da46f-1523-4b4a-bf97-cea2ef33be3c tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:42.962206 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b17da46f-1523-4b4a-bf97-cea2ef33be3c tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:42.963081 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b17da46f-1523-4b4a-bf97-cea2ef33be3c tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:42.963515 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b17da46f-1523-4b4a-bf97-cea2ef33be3c tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:42.993540 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6a7a031b-ade7-4135-b105-1e03f49f4ca0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:42.994614 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6a7a031b-ade7-4135-b105-1e03f49f4ca0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:42.999744 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b17da46f-1523-4b4a-bf97-cea2ef33be3c tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:43.000492 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b17da46f-1523-4b4a-bf97-cea2ef33be3c tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:43.001052 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-b17da46f-1523-4b4a-bf97-cea2ef33be3c tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lazy-loading 'fault' on Instance uuid 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:42:43.002809 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a7a031b-ade7-4135-b105-1e03f49f4ca0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:43.003734 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a7a031b-ade7-4135-b105-1e03f49f4ca0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:43.004974 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a7a031b-ade7-4135-b105-1e03f49f4ca0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:43.005727 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a7a031b-ade7-4135-b105-1e03f49f4ca0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:43.053764 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-b17da46f-1523-4b4a-bf97-cea2ef33be3c tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df79cdd584947ff967966692375c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273c545d66f0479bb21eb8012fb29558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:43.060694 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b17da46f-1523-4b4a-bf97-cea2ef33be3c tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 200 len: 1303 microversion: 2.1 time: 0.111976 Oct 28 08:42:43.061262 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 260/519] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:42 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 1303 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:43.138790 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-6a7a031b-ade7-4135-b105-1e03f49f4ca0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:43.147571 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6a7a031b-ade7-4135-b105-1e03f49f4ca0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1522 microversion: 2.1 time: 0.158158 Oct 28 08:42:43.148124 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 260/520] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:42 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:43.479105 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-56cebc91-67f4-4dc0-8603-10fc062624fe tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1965b193-51f5-4194-bb8f-081d95f59108"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:43.480241 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-56cebc91-67f4-4dc0-8603-10fc062624fe tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:43.487659 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56cebc91-67f4-4dc0-8603-10fc062624fe tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:43.488102 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56cebc91-67f4-4dc0-8603-10fc062624fe tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:43.488862 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56cebc91-67f4-4dc0-8603-10fc062624fe tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:43.489287 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56cebc91-67f4-4dc0-8603-10fc062624fe tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:43.740333 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-56cebc91-67f4-4dc0-8603-10fc062624fe tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "POST /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264818 Oct 28 08:42:43.741253 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 261/521] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Oct 28 08:42:43 2021] POST /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:42:43.773685 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ccd267c0-2f9a-4cba-89c2-d2dec72c0dd9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:43.774840 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ccd267c0-2f9a-4cba-89c2-d2dec72c0dd9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:43.782974 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ccd267c0-2f9a-4cba-89c2-d2dec72c0dd9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:43.783723 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ccd267c0-2f9a-4cba-89c2-d2dec72c0dd9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:43.784594 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ccd267c0-2f9a-4cba-89c2-d2dec72c0dd9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:43.785693 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ccd267c0-2f9a-4cba-89c2-d2dec72c0dd9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:43.850364 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2128035a-c57a-4efd-8fa1-fd71eafd1a8c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:43.851449 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2128035a-c57a-4efd-8fa1-fd71eafd1a8c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:43.861530 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2128035a-c57a-4efd-8fa1-fd71eafd1a8c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:43.862460 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2128035a-c57a-4efd-8fa1-fd71eafd1a8c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:43.863353 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2128035a-c57a-4efd-8fa1-fd71eafd1a8c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:43.863847 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2128035a-c57a-4efd-8fa1-fd71eafd1a8c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:43.900890 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ccd267c0-2f9a-4cba-89c2-d2dec72c0dd9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 0.130979 Oct 28 08:42:43.901674 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 261/522] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:43 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:43.949089 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2128035a-c57a-4efd-8fa1-fd71eafd1a8c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 0.102769 Oct 28 08:42:43.949767 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 262/523] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:43 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:42:44.079712 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2bdc169f-1313-493d-828b-e391d507556a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:44.080543 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2bdc169f-1313-493d-828b-e391d507556a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] [instance: 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:44.087150 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2bdc169f-1313-493d-828b-e391d507556a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:44.087596 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2bdc169f-1313-493d-828b-e391d507556a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:44.088364 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2bdc169f-1313-493d-828b-e391d507556a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:44.088786 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2bdc169f-1313-493d-828b-e391d507556a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:44.105919 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-2bdc169f-1313-493d-828b-e391d507556a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] HTTP exception thrown: Instance 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 could not be found. Oct 28 08:42:44.106662 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2bdc169f-1313-493d-828b-e391d507556a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] Returning 404 to user: Instance 8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:42:44.107483 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2bdc169f-1313-493d-828b-e391d507556a tempest-VolumesActionsTest-200350980 tempest-VolumesActionsTest-200350980-project] 10.222.0.76 "GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3" status: 404 len: 111 microversion: 2.1 time: 0.032641 Oct 28 08:42:44.108312 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 262/524] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:44 2021] GET /compute/v2.1/servers/8adcf8ce-4db0-4948-91a0-c5c0ae0b2ee3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:42:44.165641 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9015d94c-01de-4645-9e92-829cd3d5602b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:44.166246 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9015d94c-01de-4645-9e92-829cd3d5602b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:44.173276 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9015d94c-01de-4645-9e92-829cd3d5602b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:44.173653 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9015d94c-01de-4645-9e92-829cd3d5602b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:44.174420 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9015d94c-01de-4645-9e92-829cd3d5602b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:44.174997 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9015d94c-01de-4645-9e92-829cd3d5602b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:44.314631 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-9015d94c-01de-4645-9e92-829cd3d5602b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:44.322657 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9015d94c-01de-4645-9e92-829cd3d5602b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1522 microversion: 2.1 time: 0.160824 Oct 28 08:42:44.323237 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 263/525] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:44 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:44.912879 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e09a4c58-2636-488a-af81-8c0f3a77b0ca tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:44.913953 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e09a4c58-2636-488a-af81-8c0f3a77b0ca tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:44.920697 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e09a4c58-2636-488a-af81-8c0f3a77b0ca tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:44.921639 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e09a4c58-2636-488a-af81-8c0f3a77b0ca tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:44.922067 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e09a4c58-2636-488a-af81-8c0f3a77b0ca tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:44.922746 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e09a4c58-2636-488a-af81-8c0f3a77b0ca tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:44.965458 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-454b32d9-b18e-4725-8ee9-3b67c56ede89 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:44.966307 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-454b32d9-b18e-4725-8ee9-3b67c56ede89 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:44.973700 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-454b32d9-b18e-4725-8ee9-3b67c56ede89 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:44.974198 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-454b32d9-b18e-4725-8ee9-3b67c56ede89 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:44.975121 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-454b32d9-b18e-4725-8ee9-3b67c56ede89 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:44.975621 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-454b32d9-b18e-4725-8ee9-3b67c56ede89 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:45.113268 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e09a4c58-2636-488a-af81-8c0f3a77b0ca tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 0.203802 Oct 28 08:42:45.117611 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 263/526] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:44 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:45.120655 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-454b32d9-b18e-4725-8ee9-3b67c56ede89 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 0.158850 Oct 28 08:42:45.121690 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 264/527] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:44 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:42:45.340467 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f28534d1-4600-40ba-bbd5-15c07a33c9be tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:45.341154 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f28534d1-4600-40ba-bbd5-15c07a33c9be tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:45.348853 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f28534d1-4600-40ba-bbd5-15c07a33c9be tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:45.349293 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f28534d1-4600-40ba-bbd5-15c07a33c9be tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:45.350055 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f28534d1-4600-40ba-bbd5-15c07a33c9be tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:45.350572 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f28534d1-4600-40ba-bbd5-15c07a33c9be tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:45.473638 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-f28534d1-4600-40ba-bbd5-15c07a33c9be tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:45.481233 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f28534d1-4600-40ba-bbd5-15c07a33c9be tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1522 microversion: 2.1 time: 0.144740 Oct 28 08:42:45.481805 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 264/528] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:45 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:46.125522 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2e952b9c-efc9-41a3-acab-3ce1123dc145 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:46.126557 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2e952b9c-efc9-41a3-acab-3ce1123dc145 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:46.132809 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cb57538a-4072-46a6-b944-f2b8cbd74fca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:46.133708 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cb57538a-4072-46a6-b944-f2b8cbd74fca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:46.133818 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e952b9c-efc9-41a3-acab-3ce1123dc145 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:46.134195 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e952b9c-efc9-41a3-acab-3ce1123dc145 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:46.135001 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e952b9c-efc9-41a3-acab-3ce1123dc145 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:46.135436 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e952b9c-efc9-41a3-acab-3ce1123dc145 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:46.140175 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb57538a-4072-46a6-b944-f2b8cbd74fca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:46.140613 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb57538a-4072-46a6-b944-f2b8cbd74fca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:46.141384 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb57538a-4072-46a6-b944-f2b8cbd74fca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:46.141805 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb57538a-4072-46a6-b944-f2b8cbd74fca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:49.562623 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2e952b9c-efc9-41a3-acab-3ce1123dc145 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 3.441098 Oct 28 08:42:49.563279 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 265/529] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:46 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 3443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:49.568909 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fcb30db4-ed01-45b8-a570-ef9ef3ca4a05 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:49.569251 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fcb30db4-ed01-45b8-a570-ef9ef3ca4a05 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:49.573759 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cb57538a-4072-46a6-b944-f2b8cbd74fca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 3.444316 Oct 28 08:42:49.574458 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 265/530] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:46 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 3446 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:49.577386 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fcb30db4-ed01-45b8-a570-ef9ef3ca4a05 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:49.577863 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fcb30db4-ed01-45b8-a570-ef9ef3ca4a05 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:49.578714 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fcb30db4-ed01-45b8-a570-ef9ef3ca4a05 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:49.579122 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fcb30db4-ed01-45b8-a570-ef9ef3ca4a05 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:49.706482 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-fcb30db4-ed01-45b8-a570-ef9ef3ca4a05 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:49.715313 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fcb30db4-ed01-45b8-a570-ef9ef3ca4a05 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1522 microversion: 2.1 time: 0.150837 Oct 28 08:42:49.715837 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 266/531] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:49 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:50.575263 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1ad2f2c1-9066-4c9d-86fd-422fe4175c0d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:50.576252 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1ad2f2c1-9066-4c9d-86fd-422fe4175c0d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:50.584115 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ad2f2c1-9066-4c9d-86fd-422fe4175c0d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:50.584553 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ad2f2c1-9066-4c9d-86fd-422fe4175c0d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:50.585313 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ad2f2c1-9066-4c9d-86fd-422fe4175c0d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:50.585737 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ad2f2c1-9066-4c9d-86fd-422fe4175c0d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:50.586362 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9c0d0b1d-bb16-4f02-b6bd-e86219b2f48e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:50.587734 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9c0d0b1d-bb16-4f02-b6bd-e86219b2f48e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:50.594704 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c0d0b1d-bb16-4f02-b6bd-e86219b2f48e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:50.595337 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c0d0b1d-bb16-4f02-b6bd-e86219b2f48e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:50.596172 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c0d0b1d-bb16-4f02-b6bd-e86219b2f48e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:50.596585 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c0d0b1d-bb16-4f02-b6bd-e86219b2f48e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:50.713127 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1ad2f2c1-9066-4c9d-86fd-422fe4175c0d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 0.141676 Oct 28 08:42:50.714543 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 266/532] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:50 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:50.727165 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9c0d0b1d-bb16-4f02-b6bd-e86219b2f48e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 0.145625 Oct 28 08:42:50.728039 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 267/533] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:50 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:42:50.735756 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fa16123a-98a0-45c8-ac4b-28395757c8f3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:50.736436 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fa16123a-98a0-45c8-ac4b-28395757c8f3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:50.742839 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa16123a-98a0-45c8-ac4b-28395757c8f3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:50.743276 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa16123a-98a0-45c8-ac4b-28395757c8f3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:50.744027 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa16123a-98a0-45c8-ac4b-28395757c8f3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:50.744448 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa16123a-98a0-45c8-ac4b-28395757c8f3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:50.874761 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-fa16123a-98a0-45c8-ac4b-28395757c8f3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:50.882529 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fa16123a-98a0-45c8-ac4b-28395757c8f3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1522 microversion: 2.1 time: 0.151762 Oct 28 08:42:50.883098 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 267/534] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:50 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:51.727807 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a0f03020-bddb-4c43-89cd-8b00991d519e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:51.729648 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a0f03020-bddb-4c43-89cd-8b00991d519e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:51.739675 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a0aa08c9-c835-493a-ab17-06a751e5d310 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:51.741304 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a0aa08c9-c835-493a-ab17-06a751e5d310 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:51.756683 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a0aa08c9-c835-493a-ab17-06a751e5d310 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:51.763258 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0f03020-bddb-4c43-89cd-8b00991d519e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:51.763997 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a0aa08c9-c835-493a-ab17-06a751e5d310 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:51.765359 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a0aa08c9-c835-493a-ab17-06a751e5d310 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:51.765924 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0f03020-bddb-4c43-89cd-8b00991d519e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:51.766905 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0f03020-bddb-4c43-89cd-8b00991d519e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:51.767495 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a0aa08c9-c835-493a-ab17-06a751e5d310 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:51.769984 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0f03020-bddb-4c43-89cd-8b00991d519e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:51.898901 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a0aa08c9-c835-493a-ab17-06a751e5d310 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 0.162878 Oct 28 08:42:51.907134 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a0f03020-bddb-4c43-89cd-8b00991d519e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 0.184825 Oct 28 08:42:51.908480 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 268/535] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:51 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:51.915807 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 268/536] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:51 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:42:51.923613 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c6fb6608-e45b-4948-aee4-f432d9924281 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:51.924336 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c6fb6608-e45b-4948-aee4-f432d9924281 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:51.947119 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6fb6608-e45b-4948-aee4-f432d9924281 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:51.947836 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6fb6608-e45b-4948-aee4-f432d9924281 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:51.948795 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6fb6608-e45b-4948-aee4-f432d9924281 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:51.949435 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6fb6608-e45b-4948-aee4-f432d9924281 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:52.183718 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-c6fb6608-e45b-4948-aee4-f432d9924281 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:52.198184 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c6fb6608-e45b-4948-aee4-f432d9924281 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1502 microversion: 2.1 time: 0.288944 Oct 28 08:42:52.198972 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 269/537] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:51 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1502 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:52.220209 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5f1e71a3-eef2-44f7-9534-f2241c7f7306 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f29340f6-1bdb-4908-af25-f9bf8681af5d"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:52.222391 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5f1e71a3-eef2-44f7-9534-f2241c7f7306 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:52.232466 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f1e71a3-eef2-44f7-9534-f2241c7f7306 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:52.233580 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f1e71a3-eef2-44f7-9534-f2241c7f7306 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:52.234549 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f1e71a3-eef2-44f7-9534-f2241c7f7306 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:52.234991 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f1e71a3-eef2-44f7-9534-f2241c7f7306 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:52.261904 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-5f1e71a3-eef2-44f7-9534-f2241c7f7306 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] HTTP exception thrown: Cannot 'attach_volume' instance a432ca47-c48c-4e08-8b76-0025d9ef360b while it is in vm_state rescued Oct 28 08:42:52.263077 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5f1e71a3-eef2-44f7-9534-f2241c7f7306 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Returning 409 to user: Cannot 'attach_volume' instance a432ca47-c48c-4e08-8b76-0025d9ef360b while it is in vm_state rescued {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:42:52.263914 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5f1e71a3-eef2-44f7-9534-f2241c7f7306 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "POST /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049203 Oct 28 08:42:52.264900 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 269/538] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Oct 28 08:42:52 2021] POST /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 08:42:52.277111 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-72f3db53-573e-474c-962f-7a4173c3d554 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:52.278522 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-72f3db53-573e-474c-962f-7a4173c3d554 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:52.289550 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72f3db53-573e-474c-962f-7a4173c3d554 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:52.290332 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72f3db53-573e-474c-962f-7a4173c3d554 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:52.291373 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72f3db53-573e-474c-962f-7a4173c3d554 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:52.292455 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72f3db53-573e-474c-962f-7a4173c3d554 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:52.380109 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-72f3db53-573e-474c-962f-7a4173c3d554 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "POST /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b/action" status: 202 len: 0 microversion: 2.1 time: 0.108542 Oct 28 08:42:52.381001 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 270/539] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:52 2021] POST /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:42:52.390075 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f27d7db4-8829-41f0-a61c-325361fd519e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:52.391195 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f27d7db4-8829-41f0-a61c-325361fd519e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:52.400646 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f27d7db4-8829-41f0-a61c-325361fd519e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:52.401473 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f27d7db4-8829-41f0-a61c-325361fd519e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:52.402596 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f27d7db4-8829-41f0-a61c-325361fd519e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:52.403252 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f27d7db4-8829-41f0-a61c-325361fd519e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:52.552203 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-678d0ac0-ce36-4a58-b892-205b071a119d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1965b193-51f5-4194-bb8f-081d95f59108"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:52.553636 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-678d0ac0-ce36-4a58-b892-205b071a119d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:52.566361 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-678d0ac0-ce36-4a58-b892-205b071a119d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:52.567126 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-678d0ac0-ce36-4a58-b892-205b071a119d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:52.568023 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-678d0ac0-ce36-4a58-b892-205b071a119d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:52.569681 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-678d0ac0-ce36-4a58-b892-205b071a119d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:52.655747 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-f27d7db4-8829-41f0-a61c-325361fd519e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:52.663702 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f27d7db4-8829-41f0-a61c-325361fd519e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1510 microversion: 2.1 time: 0.277618 Oct 28 08:42:52.668343 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 270/540] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:52 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1510 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:52.680890 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-678d0ac0-ce36-4a58-b892-205b071a119d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] HTTP exception thrown: Invalid volume: volume 1965b193-51f5-4194-bb8f-081d95f59108 is already attached to instances: 174ae5e4-f21b-4141-88bf-98e7d5efb161 Oct 28 08:42:52.681586 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-678d0ac0-ce36-4a58-b892-205b071a119d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Returning 400 to user: Invalid volume: volume 1965b193-51f5-4194-bb8f-081d95f59108 is already attached to instances: 174ae5e4-f21b-4141-88bf-98e7d5efb161 {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:42:52.687120 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-678d0ac0-ce36-4a58-b892-205b071a119d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "POST /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.139036 Oct 28 08:42:52.688312 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 271/541] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Oct 28 08:42:52 2021] POST /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161/os-volume_attachments => generated 174 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 08:42:52.794520 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fe298c24-c987-430a-be9a-f0e0d8172179 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:52.796159 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fe298c24-c987-430a-be9a-f0e0d8172179 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:52.802470 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe298c24-c987-430a-be9a-f0e0d8172179 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:52.803150 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe298c24-c987-430a-be9a-f0e0d8172179 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:52.804105 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe298c24-c987-430a-be9a-f0e0d8172179 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:52.804686 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe298c24-c987-430a-be9a-f0e0d8172179 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:52.919453 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d0aa2150-b45d-4620-a2ca-c43733750989 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:52.923324 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d0aa2150-b45d-4620-a2ca-c43733750989 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:52.940093 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d0aa2150-b45d-4620-a2ca-c43733750989 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:52.940878 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d0aa2150-b45d-4620-a2ca-c43733750989 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:52.942471 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d0aa2150-b45d-4620-a2ca-c43733750989 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:52.943677 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d0aa2150-b45d-4620-a2ca-c43733750989 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:53.042474 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-fe298c24-c987-430a-be9a-f0e0d8172179 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lazy-loading 'services' on Instance uuid 174ae5e4-f21b-4141-88bf-98e7d5efb161 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:42:53.064738 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d0aa2150-b45d-4620-a2ca-c43733750989 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 0.149092 Oct 28 08:42:53.069093 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 272/542] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:52 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:42:53.075963 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b29bdf29-5a96-4790-b697-026a15c0da22 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:53.078444 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b29bdf29-5a96-4790-b697-026a15c0da22 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:53.090436 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b29bdf29-5a96-4790-b697-026a15c0da22 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:53.091190 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b29bdf29-5a96-4790-b697-026a15c0da22 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:53.092935 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b29bdf29-5a96-4790-b697-026a15c0da22 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:53.093589 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b29bdf29-5a96-4790-b697-026a15c0da22 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:53.172049 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b29bdf29-5a96-4790-b697-026a15c0da22 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 0.101161 Oct 28 08:42:53.173041 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 273/543] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:53 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:53.240901 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fe298c24-c987-430a-be9a-f0e0d8172179 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "DELETE /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161/os-volume_attachments/1965b193-51f5-4194-bb8f-081d95f59108" status: 202 len: 0 microversion: 2.1 time: 0.449977 Oct 28 08:42:53.241679 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 271/544] 10.222.0.76 () {58 vars in 1415 bytes} [Thu Oct 28 08:42:52 2021] DELETE /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161/os-volume_attachments/1965b193-51f5-4194-bb8f-081d95f59108 => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:53.251764 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e891c9c0-1d8c-46fc-a4a4-1dbcd5f5a37f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:53.252753 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e891c9c0-1d8c-46fc-a4a4-1dbcd5f5a37f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:53.267197 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e891c9c0-1d8c-46fc-a4a4-1dbcd5f5a37f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:53.274867 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e891c9c0-1d8c-46fc-a4a4-1dbcd5f5a37f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:53.275787 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e891c9c0-1d8c-46fc-a4a4-1dbcd5f5a37f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:53.277025 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e891c9c0-1d8c-46fc-a4a4-1dbcd5f5a37f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:53.318274 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e891c9c0-1d8c-46fc-a4a4-1dbcd5f5a37f tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072078 Oct 28 08:42:53.319583 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 274/545] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Oct 28 08:42:53 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:42:53.730438 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-34bf33de-0374-4b97-a77b-63313f5554d8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:53.732258 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-34bf33de-0374-4b97-a77b-63313f5554d8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:53.752374 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34bf33de-0374-4b97-a77b-63313f5554d8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:53.759324 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34bf33de-0374-4b97-a77b-63313f5554d8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:53.760997 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34bf33de-0374-4b97-a77b-63313f5554d8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:53.762069 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34bf33de-0374-4b97-a77b-63313f5554d8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:53.990301 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-34bf33de-0374-4b97-a77b-63313f5554d8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:54.019760 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-34bf33de-0374-4b97-a77b-63313f5554d8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1510 microversion: 2.1 time: 0.323076 Oct 28 08:42:54.022297 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 272/546] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:53 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1510 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:54.078392 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-72646756-d7e2-4f3c-9ea9-ac99519ffd70 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:54.079505 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-72646756-d7e2-4f3c-9ea9-ac99519ffd70 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:54.085748 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72646756-d7e2-4f3c-9ea9-ac99519ffd70 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:54.086580 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72646756-d7e2-4f3c-9ea9-ac99519ffd70 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:54.087433 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72646756-d7e2-4f3c-9ea9-ac99519ffd70 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:54.089107 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72646756-d7e2-4f3c-9ea9-ac99519ffd70 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:54.187589 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1f084540-3ec3-416f-904c-7c9faeaa49b1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:54.188929 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1f084540-3ec3-416f-904c-7c9faeaa49b1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:54.196678 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f084540-3ec3-416f-904c-7c9faeaa49b1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:54.197888 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f084540-3ec3-416f-904c-7c9faeaa49b1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:54.198899 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-72646756-d7e2-4f3c-9ea9-ac99519ffd70 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 0.125316 Oct 28 08:42:54.199504 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f084540-3ec3-416f-904c-7c9faeaa49b1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:54.200195 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 275/547] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:54 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:54.200680 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f084540-3ec3-416f-904c-7c9faeaa49b1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:54.314065 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1f084540-3ec3-416f-904c-7c9faeaa49b1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 0.133113 Oct 28 08:42:54.316156 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 273/548] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:54 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:42:54.331439 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5f535c47-b441-4855-9d46-2d2a134ed84a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:54.332652 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5f535c47-b441-4855-9d46-2d2a134ed84a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:54.341245 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f535c47-b441-4855-9d46-2d2a134ed84a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:54.341925 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f535c47-b441-4855-9d46-2d2a134ed84a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:54.343561 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f535c47-b441-4855-9d46-2d2a134ed84a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:54.344210 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f535c47-b441-4855-9d46-2d2a134ed84a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:54.386621 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5f535c47-b441-4855-9d46-2d2a134ed84a tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059597 Oct 28 08:42:54.387383 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 276/549] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Oct 28 08:42:54 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 08:42:54.591373 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-47e1bfff-3cb1-4373-8689-59dac4f30735 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1144813825", "imageRef": "339e99be-6a19-4324-aa16-6b690c25dede", "flavorRef": "452", "networks": [{"uuid": "baa97c96-d90c-4541-963c-2b8ac01daede"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:54.649382 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-47e1bfff-3cb1-4373-8689-59dac4f30735 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] validate_networks() for [('baa97c96-d90c-4541-963c-2b8ac01daede', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:42:55.045969 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-82fba263-e195-4a4d-b9a4-d16f587d77fb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:55.045969 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-82fba263-e195-4a4d-b9a4-d16f587d77fb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:55.045969 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82fba263-e195-4a4d-b9a4-d16f587d77fb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:55.045969 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82fba263-e195-4a4d-b9a4-d16f587d77fb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:55.046457 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82fba263-e195-4a4d-b9a4-d16f587d77fb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:55.047286 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82fba263-e195-4a4d-b9a4-d16f587d77fb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:55.240016 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-47e1bfff-3cb1-4373-8689-59dac4f30735 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:42:55.240544 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-47e1bfff-3cb1-4373-8689-59dac4f30735 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:42:55.241196 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-47e1bfff-3cb1-4373-8689-59dac4f30735 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:42:55.241814 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-47e1bfff-3cb1-4373-8689-59dac4f30735 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:42:55.242309 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-47e1bfff-3cb1-4373-8689-59dac4f30735 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:42:55.255289 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47e1bfff-3cb1-4373-8689-59dac4f30735 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:55.256883 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47e1bfff-3cb1-4373-8689-59dac4f30735 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:55.257952 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47e1bfff-3cb1-4373-8689-59dac4f30735 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:55.258588 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47e1bfff-3cb1-4373-8689-59dac4f30735 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:55.259014 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-82fba263-e195-4a4d-b9a4-d16f587d77fb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:55.267231 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-82fba263-e195-4a4d-b9a4-d16f587d77fb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1510 microversion: 2.1 time: 0.233970 Oct 28 08:42:55.282697 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-47e1bfff-3cb1-4373-8689-59dac4f30735 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Getting quotas for project 3831003e70cf4a62afb1393fbea6654e. Resources: {'instances', 'cores', 'ram'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:42:55.285763 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 277/550] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:55 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1510 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:55.287207 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-47e1bfff-3cb1-4373-8689-59dac4f30735 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Getting quotas for user e0a3f84e4d9b4c77aab465f1e4df493d and project 3831003e70cf4a62afb1393fbea6654e. Resources: {'instances', 'cores', 'ram'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:42:55.290605 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bfb9d562-d9b0-46d0-bb5e-7deb3803e589 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:55.291534 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bfb9d562-d9b0-46d0-bb5e-7deb3803e589 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:55.298680 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfb9d562-d9b0-46d0-bb5e-7deb3803e589 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:55.299496 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfb9d562-d9b0-46d0-bb5e-7deb3803e589 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:55.300275 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfb9d562-d9b0-46d0-bb5e-7deb3803e589 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:55.300825 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfb9d562-d9b0-46d0-bb5e-7deb3803e589 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:55.308531 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-47e1bfff-3cb1-4373-8689-59dac4f30735 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:42:55.313007 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-47e1bfff-3cb1-4373-8689-59dac4f30735 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='339e99be-6a19-4324-aa16-6b690c25dede',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:42:55.370111 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: ERROR oslo.messaging._drivers.impl_rabbit [None req-47e1bfff-3cb1-4373-8689-59dac4f30735 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [88cbe3d0-b3ae-4493-ba39-9e9e0880204d] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 08:42:55.392572 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bfb9d562-d9b0-46d0-bb5e-7deb3803e589 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 0.105200 Oct 28 08:42:55.393771 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 278/551] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:55 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:55.400963 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2c3eab65-1bd5-4e0e-95ff-e43f06f28711 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:55.402286 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2c3eab65-1bd5-4e0e-95ff-e43f06f28711 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:55.413121 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c3eab65-1bd5-4e0e-95ff-e43f06f28711 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:55.414022 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c3eab65-1bd5-4e0e-95ff-e43f06f28711 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:55.415505 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c3eab65-1bd5-4e0e-95ff-e43f06f28711 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:55.416182 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c3eab65-1bd5-4e0e-95ff-e43f06f28711 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:55.562776 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2c3eab65-1bd5-4e0e-95ff-e43f06f28711 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 0.166951 Oct 28 08:42:55.564569 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 279/552] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:55 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:56.293953 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-17492910-9513-4442-a3e1-33873c4ab80a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:56.294829 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-17492910-9513-4442-a3e1-33873c4ab80a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:56.301859 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17492910-9513-4442-a3e1-33873c4ab80a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:56.302406 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17492910-9513-4442-a3e1-33873c4ab80a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:56.303449 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17492910-9513-4442-a3e1-33873c4ab80a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:56.304089 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17492910-9513-4442-a3e1-33873c4ab80a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:56.394298 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [None req-47e1bfff-3cb1-4373-8689-59dac4f30735 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [88cbe3d0-b3ae-4493-ba39-9e9e0880204d] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 33742. Oct 28 08:42:56.413851 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-47e1bfff-3cb1-4373-8689-59dac4f30735 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.826319 Oct 28 08:42:56.414645 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 274/553] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Oct 28 08:42:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 1828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:42:56.436666 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-beb31ddf-474f-4b42-9812-53c69557662b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:56.444757 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-17492910-9513-4442-a3e1-33873c4ab80a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:56.452786 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-17492910-9513-4442-a3e1-33873c4ab80a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1510 microversion: 2.1 time: 0.163277 Oct 28 08:42:56.454173 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 280/554] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:56 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:42:56.459016 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4989871e-0a2c-4dbe-8c7e-804304fc01b6 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:56.459405 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-beb31ddf-474f-4b42-9812-53c69557662b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:56.460006 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4989871e-0a2c-4dbe-8c7e-804304fc01b6 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:56.484670 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-beb31ddf-474f-4b42-9812-53c69557662b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:56.485218 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-beb31ddf-474f-4b42-9812-53c69557662b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:56.486383 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-beb31ddf-474f-4b42-9812-53c69557662b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:56.487066 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-beb31ddf-474f-4b42-9812-53c69557662b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:56.525784 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-4989871e-0a2c-4dbe-8c7e-804304fc01b6 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:56.545089 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4989871e-0a2c-4dbe-8c7e-804304fc01b6 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061" status: 200 len: 1218 microversion: 2.1 time: 0.084488 Oct 28 08:42:56.547281 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 281/555] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:56 2021] GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:56.576273 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ccf00d35-2984-4c46-b855-6b64927eac99 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:56.578562 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ccf00d35-2984-4c46-b855-6b64927eac99 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:56.585898 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ccf00d35-2984-4c46-b855-6b64927eac99 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:56.586317 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ccf00d35-2984-4c46-b855-6b64927eac99 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:56.587788 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ccf00d35-2984-4c46-b855-6b64927eac99 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:56.588113 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ccf00d35-2984-4c46-b855-6b64927eac99 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:56.651078 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-beb31ddf-474f-4b42-9812-53c69557662b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 0.234715 Oct 28 08:42:56.651639 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 275/556] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:56 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:56.754812 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ccf00d35-2984-4c46-b855-6b64927eac99 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 0.182307 Oct 28 08:42:56.755646 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 282/557] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:56 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:57.473576 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a81c06c3-fd49-4df3-bfae-466342734185 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:57.474587 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a81c06c3-fd49-4df3-bfae-466342734185 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:57.487455 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a81c06c3-fd49-4df3-bfae-466342734185 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:57.488311 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a81c06c3-fd49-4df3-bfae-466342734185 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:57.489820 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a81c06c3-fd49-4df3-bfae-466342734185 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:57.490594 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a81c06c3-fd49-4df3-bfae-466342734185 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:57.565679 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-578b7acd-e2bd-4cdd-bcac-c2958dac2879 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:57.566375 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-578b7acd-e2bd-4cdd-bcac-c2958dac2879 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:57.580808 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-578b7acd-e2bd-4cdd-bcac-c2958dac2879 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:57.581438 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-578b7acd-e2bd-4cdd-bcac-c2958dac2879 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:57.584145 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-578b7acd-e2bd-4cdd-bcac-c2958dac2879 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:57.585353 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-578b7acd-e2bd-4cdd-bcac-c2958dac2879 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:57.678895 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-578b7acd-e2bd-4cdd-bcac-c2958dac2879 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:57.691468 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-578b7acd-e2bd-4cdd-bcac-c2958dac2879 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061" status: 200 len: 1214 microversion: 2.1 time: 0.129751 Oct 28 08:42:57.692859 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 283/558] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:57 2021] GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061 => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:57.699529 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ed8761c5-2029-4c37-86e4-c2c90ae25330 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:57.700735 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ed8761c5-2029-4c37-86e4-c2c90ae25330 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:57.708810 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed8761c5-2029-4c37-86e4-c2c90ae25330 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:57.709261 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed8761c5-2029-4c37-86e4-c2c90ae25330 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:57.710118 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed8761c5-2029-4c37-86e4-c2c90ae25330 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:57.710873 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed8761c5-2029-4c37-86e4-c2c90ae25330 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:57.718297 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-a81c06c3-fd49-4df3-bfae-466342734185 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:57.730315 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a81c06c3-fd49-4df3-bfae-466342734185 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1516 microversion: 2.1 time: 0.262836 Oct 28 08:42:57.743558 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 276/559] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:57 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1516 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:57.785306 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7e60e6b1-a77a-41e9-9fce-b75f824504d5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:57.790841 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7e60e6b1-a77a-41e9-9fce-b75f824504d5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:57.806403 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e60e6b1-a77a-41e9-9fce-b75f824504d5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:57.806878 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e60e6b1-a77a-41e9-9fce-b75f824504d5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:57.808816 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e60e6b1-a77a-41e9-9fce-b75f824504d5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:57.812266 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e60e6b1-a77a-41e9-9fce-b75f824504d5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:57.826950 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ed8761c5-2029-4c37-86e4-c2c90ae25330 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 0.131536 Oct 28 08:42:57.828928 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 284/560] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:57 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:57.925497 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7e60e6b1-a77a-41e9-9fce-b75f824504d5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 0.159750 Oct 28 08:42:57.926633 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 277/561] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:57 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:58.712413 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-286b09ba-6eb5-4096-9802-bfeb92d95ecb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:58.713899 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-286b09ba-6eb5-4096-9802-bfeb92d95ecb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:58.722451 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-286b09ba-6eb5-4096-9802-bfeb92d95ecb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:58.722986 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-286b09ba-6eb5-4096-9802-bfeb92d95ecb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:58.723799 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-286b09ba-6eb5-4096-9802-bfeb92d95ecb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:58.724431 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-286b09ba-6eb5-4096-9802-bfeb92d95ecb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:58.818432 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-286b09ba-6eb5-4096-9802-bfeb92d95ecb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:42:58.831718 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-286b09ba-6eb5-4096-9802-bfeb92d95ecb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061" status: 200 len: 1288 microversion: 2.1 time: 0.123418 Oct 28 08:42:58.844142 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c66bf138-acd7-4932-89c3-5182d828f265 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:58.844904 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 285/562] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:58 2021] GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061 => generated 1288 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:42:58.849177 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c66bf138-acd7-4932-89c3-5182d828f265 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:58.867099 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c66bf138-acd7-4932-89c3-5182d828f265 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:58.868051 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c66bf138-acd7-4932-89c3-5182d828f265 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:58.872287 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c66bf138-acd7-4932-89c3-5182d828f265 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:58.872900 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c66bf138-acd7-4932-89c3-5182d828f265 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:58.941121 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c8f48ca4-4efd-4538-ae10-f45f1a764d57 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:58.941121 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c8f48ca4-4efd-4538-ae10-f45f1a764d57 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:58.946867 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c66bf138-acd7-4932-89c3-5182d828f265 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 0.110750 Oct 28 08:42:58.949005 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 278/563] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:58 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:42:58.962578 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8f48ca4-4efd-4538-ae10-f45f1a764d57 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:58.963161 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8f48ca4-4efd-4538-ae10-f45f1a764d57 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:58.963961 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8f48ca4-4efd-4538-ae10-f45f1a764d57 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:58.964391 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8f48ca4-4efd-4538-ae10-f45f1a764d57 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:59.052070 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c8f48ca4-4efd-4538-ae10-f45f1a764d57 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 0.117068 Oct 28 08:42:59.057877 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 286/564] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:42:58 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:42:59.858143 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ccf7e959-7859-47a2-9274-ab1529935b04 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:42:59.858779 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ccf7e959-7859-47a2-9274-ab1529935b04 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:59.870223 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ccf7e959-7859-47a2-9274-ab1529935b04 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:59.870705 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ccf7e959-7859-47a2-9274-ab1529935b04 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:59.871495 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ccf7e959-7859-47a2-9274-ab1529935b04 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:59.871929 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ccf7e959-7859-47a2-9274-ab1529935b04 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:59.963631 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1e408b1f-33df-4e7e-a6f3-dd7769194169 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:42:59.965818 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1e408b1f-33df-4e7e-a6f3-dd7769194169 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:42:59.983953 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e408b1f-33df-4e7e-a6f3-dd7769194169 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:59.995302 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e408b1f-33df-4e7e-a6f3-dd7769194169 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:42:59.996449 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e408b1f-33df-4e7e-a6f3-dd7769194169 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:42:59.997266 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e408b1f-33df-4e7e-a6f3-dd7769194169 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:00.124464 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1e408b1f-33df-4e7e-a6f3-dd7769194169 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 0.157792 Oct 28 08:43:00.126101 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 287/565] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:42:59 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:00.132175 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-54cc297d-d4d5-4002-801b-9430703f4f25 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:00.133186 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-54cc297d-d4d5-4002-801b-9430703f4f25 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:00.143837 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54cc297d-d4d5-4002-801b-9430703f4f25 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:00.144490 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54cc297d-d4d5-4002-801b-9430703f4f25 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:00.148264 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54cc297d-d4d5-4002-801b-9430703f4f25 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:00.149225 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54cc297d-d4d5-4002-801b-9430703f4f25 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:00.259068 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-54cc297d-d4d5-4002-801b-9430703f4f25 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 0.131263 Oct 28 08:43:00.262645 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 288/566] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:00 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:00.269508 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-db9743e3-026b-474e-b021-e4a8438f1dd5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:00.272669 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-db9743e3-026b-474e-b021-e4a8438f1dd5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:00.287741 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db9743e3-026b-474e-b021-e4a8438f1dd5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:00.291504 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db9743e3-026b-474e-b021-e4a8438f1dd5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:00.293389 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db9743e3-026b-474e-b021-e4a8438f1dd5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:00.296214 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db9743e3-026b-474e-b021-e4a8438f1dd5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:00.472355 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-ccf7e959-7859-47a2-9274-ab1529935b04 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:00.480612 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ccf7e959-7859-47a2-9274-ab1529935b04 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061" status: 200 len: 1318 microversion: 2.1 time: 0.628822 Oct 28 08:43:00.495462 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 279/567] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:42:59 2021] GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061 => generated 1318 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:00.734848 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-db9743e3-026b-474e-b021-e4a8438f1dd5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:00.742296 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-db9743e3-026b-474e-b021-e4a8438f1dd5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1516 microversion: 2.1 time: 0.477103 Oct 28 08:43:00.745274 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 289/568] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:00 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1516 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:43:00.761280 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-46b107b3-58e7-4106-9b0f-6b8dd80a2982 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0213758-2f10-44cc-abde-eb942d226cf8"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:00.762437 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-46b107b3-58e7-4106-9b0f-6b8dd80a2982 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:00.773766 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46b107b3-58e7-4106-9b0f-6b8dd80a2982 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:00.774242 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46b107b3-58e7-4106-9b0f-6b8dd80a2982 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:00.776190 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46b107b3-58e7-4106-9b0f-6b8dd80a2982 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:00.776634 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46b107b3-58e7-4106-9b0f-6b8dd80a2982 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:01.136763 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e78bc6e1-5c57-4337-ab4d-9e83f16fec81 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:01.137788 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e78bc6e1-5c57-4337-ab4d-9e83f16fec81 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:01.160770 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e78bc6e1-5c57-4337-ab4d-9e83f16fec81 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:01.161673 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e78bc6e1-5c57-4337-ab4d-9e83f16fec81 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:01.165861 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e78bc6e1-5c57-4337-ab4d-9e83f16fec81 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:01.166755 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e78bc6e1-5c57-4337-ab4d-9e83f16fec81 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:01.211638 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-46b107b3-58e7-4106-9b0f-6b8dd80a2982 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "POST /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.454067 Oct 28 08:43:01.212413 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 280/569] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Oct 28 08:43:00 2021] POST /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b/os-volume_attachments => generated 194 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:43:01.276181 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a75b63cf-4720-4b2e-ab15-c5bf9ba0174d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:01.279175 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a75b63cf-4720-4b2e-ab15-c5bf9ba0174d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:01.308281 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a75b63cf-4720-4b2e-ab15-c5bf9ba0174d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:01.312288 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a75b63cf-4720-4b2e-ab15-c5bf9ba0174d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:01.313098 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a75b63cf-4720-4b2e-ab15-c5bf9ba0174d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:01.313539 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a75b63cf-4720-4b2e-ab15-c5bf9ba0174d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:01.416098 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e78bc6e1-5c57-4337-ab4d-9e83f16fec81 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 0.282854 Oct 28 08:43:01.417124 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 290/570] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:01 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:43:01.440790 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a75b63cf-4720-4b2e-ab15-c5bf9ba0174d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 0.168971 Oct 28 08:43:01.443613 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 281/571] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:01 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:01.505242 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3460540b-5a07-4467-bfde-c2fc2498e2e1 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:01.506445 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3460540b-5a07-4467-bfde-c2fc2498e2e1 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:01.519129 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3460540b-5a07-4467-bfde-c2fc2498e2e1 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:01.519993 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3460540b-5a07-4467-bfde-c2fc2498e2e1 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:01.521204 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3460540b-5a07-4467-bfde-c2fc2498e2e1 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:01.521787 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3460540b-5a07-4467-bfde-c2fc2498e2e1 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:01.761669 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-6acea805-bb7c-4c18-8afb-4015202dc662 req-fe7db7a4-4384-4939-a538-a079f6d3afdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061", "tag": "e663ba98-a487-4b76-8d8a-8e9f0d155ccc"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:01.763441 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:43:01.763441 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:43:01.782372 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6acea805-bb7c-4c18-8afb-4015202dc662 req-fe7db7a4-4384-4939-a538-a079f6d3afdc service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:01.783917 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6acea805-bb7c-4c18-8afb-4015202dc662 req-fe7db7a4-4384-4939-a538-a079f6d3afdc service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:01.807679 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3460540b-5a07-4467-bfde-c2fc2498e2e1 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:01.809493 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-6acea805-bb7c-4c18-8afb-4015202dc662 req-fe7db7a4-4384-4939-a538-a079f6d3afdc service nova] Creating event network-changed:e663ba98-a487-4b76-8d8a-8e9f0d155ccc for instance 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061 on hv-cinder-81565 Oct 28 08:43:01.814928 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3460540b-5a07-4467-bfde-c2fc2498e2e1 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061" status: 200 len: 1318 microversion: 2.1 time: 0.317772 Oct 28 08:43:01.822410 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-6acea805-bb7c-4c18-8afb-4015202dc662 req-fe7db7a4-4384-4939-a538-a079f6d3afdc service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066453 Oct 28 08:43:01.823046 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 282/572] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:43:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:43:01.828385 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 291/573] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:01 2021] GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061 => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:02.429174 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-614cfec4-51db-4dd5-ac61-1b112e5abdea tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:02.430842 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-614cfec4-51db-4dd5-ac61-1b112e5abdea tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:02.442326 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-614cfec4-51db-4dd5-ac61-1b112e5abdea tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:02.442999 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-614cfec4-51db-4dd5-ac61-1b112e5abdea tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:02.444064 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-614cfec4-51db-4dd5-ac61-1b112e5abdea tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:02.444719 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-614cfec4-51db-4dd5-ac61-1b112e5abdea tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:02.458261 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9dfd6ed0-b411-4df8-aebf-59993586d65d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:02.461098 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9dfd6ed0-b411-4df8-aebf-59993586d65d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:02.475435 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dfd6ed0-b411-4df8-aebf-59993586d65d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:02.476009 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dfd6ed0-b411-4df8-aebf-59993586d65d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:02.477370 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dfd6ed0-b411-4df8-aebf-59993586d65d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:02.478857 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dfd6ed0-b411-4df8-aebf-59993586d65d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:03.146456 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-614cfec4-51db-4dd5-ac61-1b112e5abdea tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 0.721252 Oct 28 08:43:03.150251 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 283/574] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:02 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:03.152353 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7e62bb3c-06c6-497e-b408-fc18e3ff268c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:03.153031 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7e62bb3c-06c6-497e-b408-fc18e3ff268c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:03.160565 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e62bb3c-06c6-497e-b408-fc18e3ff268c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:03.161001 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e62bb3c-06c6-497e-b408-fc18e3ff268c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:03.161760 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e62bb3c-06c6-497e-b408-fc18e3ff268c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:03.162183 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e62bb3c-06c6-497e-b408-fc18e3ff268c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:03.191809 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9dfd6ed0-b411-4df8-aebf-59993586d65d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 0.741809 Oct 28 08:43:03.192643 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 292/575] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:02 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:03.318941 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-7e62bb3c-06c6-497e-b408-fc18e3ff268c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:03.331635 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7e62bb3c-06c6-497e-b408-fc18e3ff268c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061" status: 200 len: 1318 microversion: 2.1 time: 0.182743 Oct 28 08:43:03.332485 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 284/576] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:03 2021] GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:04.162528 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6a61fa68-7dc7-4e97-b3e8-f20b2f2bd7e9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:04.163887 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6a61fa68-7dc7-4e97-b3e8-f20b2f2bd7e9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:04.172485 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a61fa68-7dc7-4e97-b3e8-f20b2f2bd7e9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:04.173008 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a61fa68-7dc7-4e97-b3e8-f20b2f2bd7e9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:04.174077 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a61fa68-7dc7-4e97-b3e8-f20b2f2bd7e9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:04.174612 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a61fa68-7dc7-4e97-b3e8-f20b2f2bd7e9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:04.205852 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-669df762-031e-44f3-a673-7305da77a8a0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:04.207509 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-669df762-031e-44f3-a673-7305da77a8a0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:04.214068 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-669df762-031e-44f3-a673-7305da77a8a0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:04.214823 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-669df762-031e-44f3-a673-7305da77a8a0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:04.215837 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-669df762-031e-44f3-a673-7305da77a8a0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:04.216322 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-669df762-031e-44f3-a673-7305da77a8a0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:04.351878 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6a61fa68-7dc7-4e97-b3e8-f20b2f2bd7e9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 0.195030 Oct 28 08:43:04.356804 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 293/577] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:04 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:04.357030 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-669df762-031e-44f3-a673-7305da77a8a0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 0.156440 Oct 28 08:43:04.358559 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 285/578] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:04 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:04.365338 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-478d8bd1-bcc5-4543-a125-1a9019e48fdb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:04.366299 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-478d8bd1-bcc5-4543-a125-1a9019e48fdb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:04.374224 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-478d8bd1-bcc5-4543-a125-1a9019e48fdb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:04.374969 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-478d8bd1-bcc5-4543-a125-1a9019e48fdb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:04.375977 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-478d8bd1-bcc5-4543-a125-1a9019e48fdb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:04.376560 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-478d8bd1-bcc5-4543-a125-1a9019e48fdb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:04.530059 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-478d8bd1-bcc5-4543-a125-1a9019e48fdb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:04.549162 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-478d8bd1-bcc5-4543-a125-1a9019e48fdb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061" status: 200 len: 1318 microversion: 2.1 time: 0.188959 Oct 28 08:43:04.550232 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 294/579] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:04 2021] GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:05.366716 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c2f29661-5602-4324-b4de-4d0cc39cdd3e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:05.368806 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c2f29661-5602-4324-b4de-4d0cc39cdd3e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:05.376467 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2f29661-5602-4324-b4de-4d0cc39cdd3e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:05.377173 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2f29661-5602-4324-b4de-4d0cc39cdd3e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:05.378308 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2f29661-5602-4324-b4de-4d0cc39cdd3e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:05.378429 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3fc6f29a-0084-481d-841b-f61c69a6f0f7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:05.379495 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2f29661-5602-4324-b4de-4d0cc39cdd3e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:05.380665 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3fc6f29a-0084-481d-841b-f61c69a6f0f7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:05.392314 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3fc6f29a-0084-481d-841b-f61c69a6f0f7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:05.393847 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3fc6f29a-0084-481d-841b-f61c69a6f0f7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:05.395700 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3fc6f29a-0084-481d-841b-f61c69a6f0f7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:05.396840 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3fc6f29a-0084-481d-841b-f61c69a6f0f7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:05.474958 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c2f29661-5602-4324-b4de-4d0cc39cdd3e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28152 microversion: 2.20 time: 0.113264 Oct 28 08:43:05.475635 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 286/580] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:05 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28152 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:43:05.492714 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3fc6f29a-0084-481d-841b-f61c69a6f0f7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 0.124642 Oct 28 08:43:05.493529 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 295/581] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:05 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:05.567622 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-86209a17-7ca0-4170-b87a-4f3a7e2173cc tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:05.568938 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-86209a17-7ca0-4170-b87a-4f3a7e2173cc tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:05.577925 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86209a17-7ca0-4170-b87a-4f3a7e2173cc tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:05.579062 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86209a17-7ca0-4170-b87a-4f3a7e2173cc tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:05.580238 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86209a17-7ca0-4170-b87a-4f3a7e2173cc tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:05.581049 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86209a17-7ca0-4170-b87a-4f3a7e2173cc tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:05.817769 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-86209a17-7ca0-4170-b87a-4f3a7e2173cc tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:05.827351 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-86209a17-7ca0-4170-b87a-4f3a7e2173cc tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061" status: 200 len: 1318 microversion: 2.1 time: 0.263278 Oct 28 08:43:05.839258 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 287/582] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:05 2021] GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:06.488494 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a17ba6c7-6f48-452e-baa3-7a659431b070 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:06.490352 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a17ba6c7-6f48-452e-baa3-7a659431b070 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:06.497397 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a17ba6c7-6f48-452e-baa3-7a659431b070 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:06.498613 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a17ba6c7-6f48-452e-baa3-7a659431b070 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:06.499614 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a17ba6c7-6f48-452e-baa3-7a659431b070 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:06.500452 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a17ba6c7-6f48-452e-baa3-7a659431b070 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:06.505327 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7ba77294-1f1d-46f7-9c7e-a6e75eb23448 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:06.506335 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7ba77294-1f1d-46f7-9c7e-a6e75eb23448 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:06.512742 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ba77294-1f1d-46f7-9c7e-a6e75eb23448 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:06.513690 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ba77294-1f1d-46f7-9c7e-a6e75eb23448 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:06.515237 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ba77294-1f1d-46f7-9c7e-a6e75eb23448 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:06.515872 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ba77294-1f1d-46f7-9c7e-a6e75eb23448 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:06.755482 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a17ba6c7-6f48-452e-baa3-7a659431b070 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28279 microversion: 2.20 time: 0.271290 Oct 28 08:43:06.760107 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7ba77294-1f1d-46f7-9c7e-a6e75eb23448 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28206 microversion: 2.1 time: 0.258356 Oct 28 08:43:06.760740 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 288/583] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:06 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28206 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:06.764959 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 296/584] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:06 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28279 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:43:06.849188 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1f4cf333-a5f7-4057-8c51-a09cabbfac52 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:06.851174 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1f4cf333-a5f7-4057-8c51-a09cabbfac52 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:06.860683 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f4cf333-a5f7-4057-8c51-a09cabbfac52 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:06.861503 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f4cf333-a5f7-4057-8c51-a09cabbfac52 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:06.862792 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f4cf333-a5f7-4057-8c51-a09cabbfac52 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:06.863360 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f4cf333-a5f7-4057-8c51-a09cabbfac52 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:07.019999 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-1f4cf333-a5f7-4057-8c51-a09cabbfac52 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:07.028258 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1f4cf333-a5f7-4057-8c51-a09cabbfac52 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061" status: 200 len: 1318 microversion: 2.1 time: 0.185736 Oct 28 08:43:07.028830 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 289/585] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:06 2021] GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:07.773079 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-55beb54f-d136-4e26-baff-9cad64ba7285 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:07.774042 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-55beb54f-d136-4e26-baff-9cad64ba7285 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:07.774562 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-09c60933-131c-4879-81c0-8fff89daa337 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:07.776241 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-09c60933-131c-4879-81c0-8fff89daa337 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:07.786362 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55beb54f-d136-4e26-baff-9cad64ba7285 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:07.786842 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55beb54f-d136-4e26-baff-9cad64ba7285 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:07.787638 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55beb54f-d136-4e26-baff-9cad64ba7285 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:07.788077 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55beb54f-d136-4e26-baff-9cad64ba7285 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:07.788692 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-09c60933-131c-4879-81c0-8fff89daa337 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:07.789453 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-09c60933-131c-4879-81c0-8fff89daa337 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:07.790654 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-09c60933-131c-4879-81c0-8fff89daa337 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:07.791603 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-09c60933-131c-4879-81c0-8fff89daa337 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:08.020186 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-09c60933-131c-4879-81c0-8fff89daa337 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28443 microversion: 2.20 time: 0.249092 Oct 28 08:43:08.020806 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 290/586] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:07 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28443 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:08.048302 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f4d4b8ee-f2ae-4383-b1ce-990f7a1c290c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:08.049312 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f4d4b8ee-f2ae-4383-b1ce-990f7a1c290c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:08.058174 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-55beb54f-d136-4e26-baff-9cad64ba7285 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28497 microversion: 2.1 time: 0.286995 Oct 28 08:43:08.063330 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4d4b8ee-f2ae-4383-b1ce-990f7a1c290c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:08.064484 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4d4b8ee-f2ae-4383-b1ce-990f7a1c290c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:08.064679 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 297/587] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:07 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28497 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:08.066407 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4d4b8ee-f2ae-4383-b1ce-990f7a1c290c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:08.067463 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4d4b8ee-f2ae-4383-b1ce-990f7a1c290c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:08.285986 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-f4d4b8ee-f2ae-4383-b1ce-990f7a1c290c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:08.293856 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f4d4b8ee-f2ae-4383-b1ce-990f7a1c290c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061" status: 200 len: 1318 microversion: 2.1 time: 0.250249 Oct 28 08:43:08.295581 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 291/588] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:08 2021] GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:09.028801 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1b0791fa-9190-4705-b5c2-5eb6b96051ce tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:09.030685 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1b0791fa-9190-4705-b5c2-5eb6b96051ce tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:09.032246 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7fe6175b-2f18-4fed-bfa2-4fac4a67f014 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:09.033740 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7fe6175b-2f18-4fed-bfa2-4fac4a67f014 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:09.039136 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b0791fa-9190-4705-b5c2-5eb6b96051ce tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:09.040015 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b0791fa-9190-4705-b5c2-5eb6b96051ce tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:09.041153 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b0791fa-9190-4705-b5c2-5eb6b96051ce tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:09.041761 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b0791fa-9190-4705-b5c2-5eb6b96051ce tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:09.045651 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fe6175b-2f18-4fed-bfa2-4fac4a67f014 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:09.046106 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fe6175b-2f18-4fed-bfa2-4fac4a67f014 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:09.048345 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fe6175b-2f18-4fed-bfa2-4fac4a67f014 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:09.048782 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fe6175b-2f18-4fed-bfa2-4fac4a67f014 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:09.071511 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-1b0791fa-9190-4705-b5c2-5eb6b96051ce tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lazy-loading 'flavor' on Instance uuid a432ca47-c48c-4e08-8b76-0025d9ef360b {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:43:09.331121 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1b0791fa-9190-4705-b5c2-5eb6b96051ce tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "POST /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b/action" status: 200 len: 32 microversion: 2.1 time: 0.306591 Oct 28 08:43:09.335473 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 298/589] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:09 2021] POST /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b/action => generated 32 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 08:43:09.350315 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a4a2f8a1-7513-4f3d-8aa4-fbd320a35782 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:09.352645 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a4a2f8a1-7513-4f3d-8aa4-fbd320a35782 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:09.366051 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4a2f8a1-7513-4f3d-8aa4-fbd320a35782 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:09.366526 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4a2f8a1-7513-4f3d-8aa4-fbd320a35782 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:09.367334 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4a2f8a1-7513-4f3d-8aa4-fbd320a35782 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:09.367767 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4a2f8a1-7513-4f3d-8aa4-fbd320a35782 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:09.826456 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7fe6175b-2f18-4fed-bfa2-4fac4a67f014 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28443 microversion: 2.20 time: 0.797693 Oct 28 08:43:09.827889 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 292/590] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:09 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28443 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:43:09.833279 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7d85e9c5-1751-4fb4-884a-daebf72fdadd tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:09.833977 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7d85e9c5-1751-4fb4-884a-daebf72fdadd tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:09.834351 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a4a2f8a1-7513-4f3d-8aa4-fbd320a35782 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28497 microversion: 2.1 time: 0.488185 Oct 28 08:43:09.835127 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 299/591] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:09 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28497 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:09.842443 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fe9d231b-f88e-4f3b-b85b-1c3d984e6a27 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:09.843538 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fe9d231b-f88e-4f3b-b85b-1c3d984e6a27 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:09.846102 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d85e9c5-1751-4fb4-884a-daebf72fdadd tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:09.847035 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d85e9c5-1751-4fb4-884a-daebf72fdadd tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:09.847988 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d85e9c5-1751-4fb4-884a-daebf72fdadd tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:09.848578 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d85e9c5-1751-4fb4-884a-daebf72fdadd tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:09.862008 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe9d231b-f88e-4f3b-b85b-1c3d984e6a27 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:09.868479 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe9d231b-f88e-4f3b-b85b-1c3d984e6a27 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:09.872263 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe9d231b-f88e-4f3b-b85b-1c3d984e6a27 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:09.872997 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe9d231b-f88e-4f3b-b85b-1c3d984e6a27 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:10.222227 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-fe9d231b-f88e-4f3b-b85b-1c3d984e6a27 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:10.227081 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-7d85e9c5-1751-4fb4-884a-daebf72fdadd tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:10.231612 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fe9d231b-f88e-4f3b-b85b-1c3d984e6a27 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1568 microversion: 2.1 time: 0.395109 Oct 28 08:43:10.233313 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 300/592] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:09 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1568 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:10.235062 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7d85e9c5-1751-4fb4-884a-daebf72fdadd tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061" status: 200 len: 1318 microversion: 2.1 time: 0.405550 Oct 28 08:43:10.240346 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 293/593] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:09 2021] GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061 => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:10.632677 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-e2b7b5b2-52b5-4da9-9188-f59e6b4e52a9 req-b86aad3b-c1e0-41a8-99c0-a2a432e584a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061", "name": "network-vif-plugged", "status": "completed", "tag": "e663ba98-a487-4b76-8d8a-8e9f0d155ccc"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:10.634272 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:43:10.634272 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:43:10.649054 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e2b7b5b2-52b5-4da9-9188-f59e6b4e52a9 req-b86aad3b-c1e0-41a8-99c0-a2a432e584a2 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:10.649054 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e2b7b5b2-52b5-4da9-9188-f59e6b4e52a9 req-b86aad3b-c1e0-41a8-99c0-a2a432e584a2 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:10.662133 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e2b7b5b2-52b5-4da9-9188-f59e6b4e52a9 req-b86aad3b-c1e0-41a8-99c0-a2a432e584a2 service nova] Creating event network-vif-plugged:e663ba98-a487-4b76-8d8a-8e9f0d155ccc for instance 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061 on hv-cinder-81565 Oct 28 08:43:10.667354 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-e2b7b5b2-52b5-4da9-9188-f59e6b4e52a9 req-b86aad3b-c1e0-41a8-99c0-a2a432e584a2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039338 Oct 28 08:43:10.668190 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 301/594] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:43:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:43:10.838440 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e9c0fa78-3ac9-4c63-a048-cf4c6655bba4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:10.839435 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e9c0fa78-3ac9-4c63-a048-cf4c6655bba4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:10.845906 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cc96ef52-0fba-4b19-91bd-3dc986839676 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:10.846399 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9c0fa78-3ac9-4c63-a048-cf4c6655bba4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:10.847132 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9c0fa78-3ac9-4c63-a048-cf4c6655bba4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:10.847249 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cc96ef52-0fba-4b19-91bd-3dc986839676 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:10.847997 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9c0fa78-3ac9-4c63-a048-cf4c6655bba4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:10.848339 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9c0fa78-3ac9-4c63-a048-cf4c6655bba4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:10.853192 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc96ef52-0fba-4b19-91bd-3dc986839676 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:10.853651 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc96ef52-0fba-4b19-91bd-3dc986839676 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:10.854420 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc96ef52-0fba-4b19-91bd-3dc986839676 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:10.854880 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc96ef52-0fba-4b19-91bd-3dc986839676 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:10.959110 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e9c0fa78-3ac9-4c63-a048-cf4c6655bba4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28443 microversion: 2.20 time: 0.124172 Oct 28 08:43:10.959782 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 294/595] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:10 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28443 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:10.966088 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cc96ef52-0fba-4b19-91bd-3dc986839676 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28497 microversion: 2.1 time: 0.124287 Oct 28 08:43:10.967283 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 302/596] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:10 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28497 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:11.249961 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2065ad67-7360-4cac-accc-9dc394548b75 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:11.250610 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2065ad67-7360-4cac-accc-9dc394548b75 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:11.257274 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-961de174-a23e-4c55-98a8-4d93cbc6c172 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:11.257771 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2065ad67-7360-4cac-accc-9dc394548b75 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:11.257959 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-961de174-a23e-4c55-98a8-4d93cbc6c172 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:11.258068 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2065ad67-7360-4cac-accc-9dc394548b75 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:11.258861 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2065ad67-7360-4cac-accc-9dc394548b75 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:11.259295 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2065ad67-7360-4cac-accc-9dc394548b75 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:11.264767 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-961de174-a23e-4c55-98a8-4d93cbc6c172 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:11.265203 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-961de174-a23e-4c55-98a8-4d93cbc6c172 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:11.265963 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-961de174-a23e-4c55-98a8-4d93cbc6c172 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:11.266386 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-961de174-a23e-4c55-98a8-4d93cbc6c172 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:11.441101 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-961de174-a23e-4c55-98a8-4d93cbc6c172 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:11.443872 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-2065ad67-7360-4cac-accc-9dc394548b75 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:11.448366 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-961de174-a23e-4c55-98a8-4d93cbc6c172 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061" status: 200 len: 1318 microversion: 2.1 time: 0.195005 Oct 28 08:43:11.448925 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 303/597] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:11 2021] GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:43:11.452304 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2065ad67-7360-4cac-accc-9dc394548b75 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1568 microversion: 2.1 time: 0.206861 Oct 28 08:43:11.452860 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 295/598] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:11 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1568 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:11.975901 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d62604ba-7b02-46f9-9bc6-5e1e34f98744 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:11.975901 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d62604ba-7b02-46f9-9bc6-5e1e34f98744 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:11.977757 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-41f41900-4407-4ec4-b6e4-241373da9247 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:11.978245 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d62604ba-7b02-46f9-9bc6-5e1e34f98744 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:11.978722 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d62604ba-7b02-46f9-9bc6-5e1e34f98744 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:11.978854 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-41f41900-4407-4ec4-b6e4-241373da9247 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:11.979498 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d62604ba-7b02-46f9-9bc6-5e1e34f98744 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:11.979924 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d62604ba-7b02-46f9-9bc6-5e1e34f98744 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:11.986668 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41f41900-4407-4ec4-b6e4-241373da9247 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:11.987112 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41f41900-4407-4ec4-b6e4-241373da9247 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:11.987876 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41f41900-4407-4ec4-b6e4-241373da9247 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:11.988463 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41f41900-4407-4ec4-b6e4-241373da9247 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:12.094575 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d62604ba-7b02-46f9-9bc6-5e1e34f98744 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.127312 Oct 28 08:43:12.098693 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 304/599] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:11 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:12.148406 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-41f41900-4407-4ec4-b6e4-241373da9247 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.174586 Oct 28 08:43:12.149237 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 296/600] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:11 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:12.466279 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-58e4d726-2a15-4844-80a7-ac05fea5d8d1 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:12.467539 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-58e4d726-2a15-4844-80a7-ac05fea5d8d1 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:12.469842 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c997ebc5-363b-42d0-ad4a-0e2bddc62d31 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:12.470558 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c997ebc5-363b-42d0-ad4a-0e2bddc62d31 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:12.475100 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58e4d726-2a15-4844-80a7-ac05fea5d8d1 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:12.475640 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58e4d726-2a15-4844-80a7-ac05fea5d8d1 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:12.476413 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58e4d726-2a15-4844-80a7-ac05fea5d8d1 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:12.476843 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58e4d726-2a15-4844-80a7-ac05fea5d8d1 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:12.477573 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c997ebc5-363b-42d0-ad4a-0e2bddc62d31 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:12.478018 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c997ebc5-363b-42d0-ad4a-0e2bddc62d31 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:12.478814 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c997ebc5-363b-42d0-ad4a-0e2bddc62d31 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:12.479251 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c997ebc5-363b-42d0-ad4a-0e2bddc62d31 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:12.660096 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c997ebc5-363b-42d0-ad4a-0e2bddc62d31 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:12.667418 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-58e4d726-2a15-4844-80a7-ac05fea5d8d1 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:12.667883 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c997ebc5-363b-42d0-ad4a-0e2bddc62d31 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1568 microversion: 2.1 time: 0.202456 Oct 28 08:43:12.668468 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 297/601] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:12 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1568 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:43:12.675484 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-58e4d726-2a15-4844-80a7-ac05fea5d8d1 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061" status: 200 len: 1318 microversion: 2.1 time: 0.213706 Oct 28 08:43:12.676046 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 305/602] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:12 2021] GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:13.106423 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cbdfb933-7735-42f6-b293-5bcd80ef3325 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:13.107430 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cbdfb933-7735-42f6-b293-5bcd80ef3325 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:13.113639 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cbdfb933-7735-42f6-b293-5bcd80ef3325 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:13.114078 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cbdfb933-7735-42f6-b293-5bcd80ef3325 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:13.114863 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cbdfb933-7735-42f6-b293-5bcd80ef3325 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:13.115292 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cbdfb933-7735-42f6-b293-5bcd80ef3325 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:13.160655 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1383d21d-8211-4fa5-8b03-bebcf96c7a8f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:13.161561 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1383d21d-8211-4fa5-8b03-bebcf96c7a8f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:13.167903 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1383d21d-8211-4fa5-8b03-bebcf96c7a8f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:13.168346 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1383d21d-8211-4fa5-8b03-bebcf96c7a8f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:13.169105 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1383d21d-8211-4fa5-8b03-bebcf96c7a8f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:13.169642 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1383d21d-8211-4fa5-8b03-bebcf96c7a8f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:13.179810 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cbdfb933-7735-42f6-b293-5bcd80ef3325 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.077023 Oct 28 08:43:13.183121 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 298/603] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:13 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:13.233922 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1383d21d-8211-4fa5-8b03-bebcf96c7a8f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.076663 Oct 28 08:43:13.234465 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 306/604] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:13 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:13.692184 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d8a55a15-c8bc-4aac-bc82-d4404421be83 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:13.693619 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d8a55a15-c8bc-4aac-bc82-d4404421be83 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:13.695748 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5abc2cbc-9e7e-4565-973f-8fda3e4993b9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:13.697437 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5abc2cbc-9e7e-4565-973f-8fda3e4993b9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:13.713044 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8a55a15-c8bc-4aac-bc82-d4404421be83 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:13.713492 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8a55a15-c8bc-4aac-bc82-d4404421be83 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:13.714271 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8a55a15-c8bc-4aac-bc82-d4404421be83 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:13.716623 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5abc2cbc-9e7e-4565-973f-8fda3e4993b9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:13.717301 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8a55a15-c8bc-4aac-bc82-d4404421be83 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:13.722620 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5abc2cbc-9e7e-4565-973f-8fda3e4993b9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:13.723882 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5abc2cbc-9e7e-4565-973f-8fda3e4993b9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:13.724502 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5abc2cbc-9e7e-4565-973f-8fda3e4993b9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:13.944786 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-d8a55a15-c8bc-4aac-bc82-d4404421be83 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:13.956149 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d8a55a15-c8bc-4aac-bc82-d4404421be83 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061" status: 200 len: 1508 microversion: 2.1 time: 0.267980 Oct 28 08:43:13.956841 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 307/605] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:13 2021] GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061 => generated 1508 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:13.966087 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-5abc2cbc-9e7e-4565-973f-8fda3e4993b9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:13.989702 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5abc2cbc-9e7e-4565-973f-8fda3e4993b9 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1568 microversion: 2.1 time: 0.308055 Oct 28 08:43:13.990291 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 299/606] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:13 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1568 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:14.192542 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f0fc851a-d288-470b-8f6a-7ef502616a2b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:14.194347 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f0fc851a-d288-470b-8f6a-7ef502616a2b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:14.207308 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0fc851a-d288-470b-8f6a-7ef502616a2b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:14.208230 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0fc851a-d288-470b-8f6a-7ef502616a2b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:14.209359 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0fc851a-d288-470b-8f6a-7ef502616a2b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:14.209863 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0fc851a-d288-470b-8f6a-7ef502616a2b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:14.245410 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6eeff0df-9c5d-4353-adfd-e0c40813ce7d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:14.246212 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6eeff0df-9c5d-4353-adfd-e0c40813ce7d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:14.254123 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6eeff0df-9c5d-4353-adfd-e0c40813ce7d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:14.254597 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6eeff0df-9c5d-4353-adfd-e0c40813ce7d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:14.256133 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6eeff0df-9c5d-4353-adfd-e0c40813ce7d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:14.256744 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6eeff0df-9c5d-4353-adfd-e0c40813ce7d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:14.301246 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f0fc851a-d288-470b-8f6a-7ef502616a2b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.113010 Oct 28 08:43:14.302078 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 308/607] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:14 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:14.357293 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6eeff0df-9c5d-4353-adfd-e0c40813ce7d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.115400 Oct 28 08:43:14.358644 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 300/608] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:14 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:15.007543 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3722b2d7-ab8c-44ee-ad1e-eb808dc94413 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:15.008255 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3722b2d7-ab8c-44ee-ad1e-eb808dc94413 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:15.015931 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3722b2d7-ab8c-44ee-ad1e-eb808dc94413 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:15.016361 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3722b2d7-ab8c-44ee-ad1e-eb808dc94413 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:15.017133 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3722b2d7-ab8c-44ee-ad1e-eb808dc94413 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:15.017567 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3722b2d7-ab8c-44ee-ad1e-eb808dc94413 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:15.146344 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3722b2d7-ab8c-44ee-ad1e-eb808dc94413 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:15.156864 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3722b2d7-ab8c-44ee-ad1e-eb808dc94413 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1568 microversion: 2.1 time: 0.153350 Oct 28 08:43:15.157523 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 309/609] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:15 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:15.313917 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e8bbed65-4e12-4482-9180-2d9925811f4d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:15.314954 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e8bbed65-4e12-4482-9180-2d9925811f4d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:15.322055 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8bbed65-4e12-4482-9180-2d9925811f4d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:15.322527 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8bbed65-4e12-4482-9180-2d9925811f4d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:15.323307 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8bbed65-4e12-4482-9180-2d9925811f4d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:15.323739 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8bbed65-4e12-4482-9180-2d9925811f4d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:15.369071 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9cd4ce43-6489-42d9-ac79-bb06c47dcd21 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:15.369985 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9cd4ce43-6489-42d9-ac79-bb06c47dcd21 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:15.377319 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cd4ce43-6489-42d9-ac79-bb06c47dcd21 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:15.377772 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cd4ce43-6489-42d9-ac79-bb06c47dcd21 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:15.378552 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cd4ce43-6489-42d9-ac79-bb06c47dcd21 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:15.379277 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cd4ce43-6489-42d9-ac79-bb06c47dcd21 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:15.391200 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e8bbed65-4e12-4482-9180-2d9925811f4d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.081271 Oct 28 08:43:15.392864 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 301/610] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:15 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:15.409598 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f4753bf8-415a-411c-b567-b4a2a395cf8e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e6a97a0-475c-4caf-b87e-a0e80d2d245d"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:15.411253 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f4753bf8-415a-411c-b567-b4a2a395cf8e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:15.418202 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4753bf8-415a-411c-b567-b4a2a395cf8e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:15.418677 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4753bf8-415a-411c-b567-b4a2a395cf8e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:15.420117 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4753bf8-415a-411c-b567-b4a2a395cf8e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:15.420717 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4753bf8-415a-411c-b567-b4a2a395cf8e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:15.453786 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9cd4ce43-6489-42d9-ac79-bb06c47dcd21 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.088296 Oct 28 08:43:15.454429 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 310/611] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:15 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:15.662941 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f4753bf8-415a-411c-b567-b4a2a395cf8e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "POST /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257764 Oct 28 08:43:15.663544 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 302/612] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Oct 28 08:43:15 2021] POST /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:43:16.176284 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9fe86346-5e25-4482-adcc-cb2e874eb76d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:16.176942 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9fe86346-5e25-4482-adcc-cb2e874eb76d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:16.183901 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fe86346-5e25-4482-adcc-cb2e874eb76d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:16.184376 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fe86346-5e25-4482-adcc-cb2e874eb76d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:16.185256 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fe86346-5e25-4482-adcc-cb2e874eb76d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:16.185659 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fe86346-5e25-4482-adcc-cb2e874eb76d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:16.321139 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-9fe86346-5e25-4482-adcc-cb2e874eb76d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:16.329991 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9fe86346-5e25-4482-adcc-cb2e874eb76d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1568 microversion: 2.1 time: 0.158580 Oct 28 08:43:16.330586 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 311/613] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:16 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:16.405537 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fe2fc310-ea6b-4f40-b306-f923bf4fae2f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:16.406614 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fe2fc310-ea6b-4f40-b306-f923bf4fae2f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:16.413699 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe2fc310-ea6b-4f40-b306-f923bf4fae2f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:16.414319 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe2fc310-ea6b-4f40-b306-f923bf4fae2f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:16.415259 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe2fc310-ea6b-4f40-b306-f923bf4fae2f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:16.415845 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe2fc310-ea6b-4f40-b306-f923bf4fae2f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:16.465176 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ca010b7f-b6a5-445b-a326-fca48b00f1e7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:16.465993 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ca010b7f-b6a5-445b-a326-fca48b00f1e7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:16.473037 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca010b7f-b6a5-445b-a326-fca48b00f1e7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:16.473414 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca010b7f-b6a5-445b-a326-fca48b00f1e7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:16.474169 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca010b7f-b6a5-445b-a326-fca48b00f1e7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:16.474614 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca010b7f-b6a5-445b-a326-fca48b00f1e7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:16.491747 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fe2fc310-ea6b-4f40-b306-f923bf4fae2f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.090695 Oct 28 08:43:16.496362 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 303/614] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:16 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:43:16.557804 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ca010b7f-b6a5-445b-a326-fca48b00f1e7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.096045 Oct 28 08:43:16.558774 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 312/615] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:16 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:17.348436 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8246a15f-11c1-46fe-b6b5-047b57a4622e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:17.349124 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8246a15f-11c1-46fe-b6b5-047b57a4622e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:17.355887 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8246a15f-11c1-46fe-b6b5-047b57a4622e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:17.356335 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8246a15f-11c1-46fe-b6b5-047b57a4622e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:17.357622 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8246a15f-11c1-46fe-b6b5-047b57a4622e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:17.358046 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8246a15f-11c1-46fe-b6b5-047b57a4622e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:17.486720 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-8246a15f-11c1-46fe-b6b5-047b57a4622e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:17.494920 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8246a15f-11c1-46fe-b6b5-047b57a4622e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1568 microversion: 2.1 time: 0.150801 Oct 28 08:43:17.495402 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 304/616] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:17 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:17.505334 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2727e4e2-4e2d-4d6c-b8ea-abc978eca8a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:17.506330 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2727e4e2-4e2d-4d6c-b8ea-abc978eca8a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:17.513114 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2727e4e2-4e2d-4d6c-b8ea-abc978eca8a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:17.513693 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2727e4e2-4e2d-4d6c-b8ea-abc978eca8a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:17.514457 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2727e4e2-4e2d-4d6c-b8ea-abc978eca8a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:17.514913 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2727e4e2-4e2d-4d6c-b8ea-abc978eca8a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:17.569073 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-053af526-4a7c-4132-ad66-819f6b487d44 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:17.569894 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-053af526-4a7c-4132-ad66-819f6b487d44 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:17.575723 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-053af526-4a7c-4132-ad66-819f6b487d44 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:17.576171 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-053af526-4a7c-4132-ad66-819f6b487d44 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:17.576937 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-053af526-4a7c-4132-ad66-819f6b487d44 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:17.577371 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-053af526-4a7c-4132-ad66-819f6b487d44 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:17.591060 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2727e4e2-4e2d-4d6c-b8ea-abc978eca8a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.089496 Oct 28 08:43:17.591875 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 313/617] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:17 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:17.652203 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-053af526-4a7c-4132-ad66-819f6b487d44 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.086637 Oct 28 08:43:17.652846 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 305/618] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:17 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:18.512039 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-402d6e6a-1f1d-47a0-bca7-84acf22a590b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:18.512637 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-402d6e6a-1f1d-47a0-bca7-84acf22a590b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:18.520539 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-402d6e6a-1f1d-47a0-bca7-84acf22a590b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:18.520970 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-402d6e6a-1f1d-47a0-bca7-84acf22a590b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:18.521722 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-402d6e6a-1f1d-47a0-bca7-84acf22a590b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:18.522151 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-402d6e6a-1f1d-47a0-bca7-84acf22a590b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:18.604002 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ab3607ca-7365-440f-a739-82e274246e6d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:18.604999 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ab3607ca-7365-440f-a739-82e274246e6d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:18.612385 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab3607ca-7365-440f-a739-82e274246e6d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:18.612825 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab3607ca-7365-440f-a739-82e274246e6d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:18.613581 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab3607ca-7365-440f-a739-82e274246e6d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:18.614019 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab3607ca-7365-440f-a739-82e274246e6d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:18.648193 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-402d6e6a-1f1d-47a0-bca7-84acf22a590b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:18.656396 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-402d6e6a-1f1d-47a0-bca7-84acf22a590b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1568 microversion: 2.1 time: 0.148325 Oct 28 08:43:18.657600 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 314/619] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:18 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:18.663190 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a1346e4c-a5a9-4646-a7e8-441737f1cca4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:18.664375 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a1346e4c-a5a9-4646-a7e8-441737f1cca4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:18.670844 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1346e4c-a5a9-4646-a7e8-441737f1cca4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:18.671282 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1346e4c-a5a9-4646-a7e8-441737f1cca4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:18.672046 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1346e4c-a5a9-4646-a7e8-441737f1cca4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:18.672471 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1346e4c-a5a9-4646-a7e8-441737f1cca4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:18.694434 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ab3607ca-7365-440f-a739-82e274246e6d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.094260 Oct 28 08:43:18.698302 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 306/620] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:18 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:43:18.771398 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a1346e4c-a5a9-4646-a7e8-441737f1cca4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.111284 Oct 28 08:43:18.771954 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 315/621] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:18 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:19.674582 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7bc7c2d8-4278-4605-99e1-bbb7f89894fb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:19.675307 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7bc7c2d8-4278-4605-99e1-bbb7f89894fb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:19.682020 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bc7c2d8-4278-4605-99e1-bbb7f89894fb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:19.682465 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bc7c2d8-4278-4605-99e1-bbb7f89894fb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:19.683244 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bc7c2d8-4278-4605-99e1-bbb7f89894fb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:19.683668 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bc7c2d8-4278-4605-99e1-bbb7f89894fb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:19.706291 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0092acfc-ec43-4df7-818d-9444fe1e43ed tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:19.707322 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0092acfc-ec43-4df7-818d-9444fe1e43ed tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:19.714075 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0092acfc-ec43-4df7-818d-9444fe1e43ed tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:19.714531 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0092acfc-ec43-4df7-818d-9444fe1e43ed tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:19.715300 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0092acfc-ec43-4df7-818d-9444fe1e43ed tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:19.715726 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0092acfc-ec43-4df7-818d-9444fe1e43ed tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:19.802588 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0092acfc-ec43-4df7-818d-9444fe1e43ed tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.100120 Oct 28 08:43:19.806438 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 316/622] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:19 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:43:19.808300 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3ee260b6-12fd-4084-8d31-1c91a8328550 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:19.809413 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3ee260b6-12fd-4084-8d31-1c91a8328550 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:19.816979 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3ee260b6-12fd-4084-8d31-1c91a8328550 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:19.817396 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3ee260b6-12fd-4084-8d31-1c91a8328550 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:19.817984 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-7bc7c2d8-4278-4605-99e1-bbb7f89894fb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:19.818168 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3ee260b6-12fd-4084-8d31-1c91a8328550 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:19.818644 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3ee260b6-12fd-4084-8d31-1c91a8328550 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:19.826349 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7bc7c2d8-4278-4605-99e1-bbb7f89894fb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1568 microversion: 2.1 time: 0.156535 Oct 28 08:43:19.827165 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 307/623] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:19 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:19.897972 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3ee260b6-12fd-4084-8d31-1c91a8328550 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.093168 Oct 28 08:43:19.898643 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 317/624] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:19 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:20.814407 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-05eb0fe7-9b05-4ea7-b2c9-29673da66e97 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:20.815525 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-05eb0fe7-9b05-4ea7-b2c9-29673da66e97 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:20.821912 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05eb0fe7-9b05-4ea7-b2c9-29673da66e97 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:20.822343 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05eb0fe7-9b05-4ea7-b2c9-29673da66e97 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:20.823280 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05eb0fe7-9b05-4ea7-b2c9-29673da66e97 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:20.823718 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05eb0fe7-9b05-4ea7-b2c9-29673da66e97 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:20.843965 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-88a40184-6e18-4a53-961b-2a16ffd22ce6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:20.844647 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-88a40184-6e18-4a53-961b-2a16ffd22ce6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:20.851678 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88a40184-6e18-4a53-961b-2a16ffd22ce6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:20.852114 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88a40184-6e18-4a53-961b-2a16ffd22ce6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:20.852871 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88a40184-6e18-4a53-961b-2a16ffd22ce6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:20.853290 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88a40184-6e18-4a53-961b-2a16ffd22ce6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:20.910239 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-05eb0fe7-9b05-4ea7-b2c9-29673da66e97 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.099699 Oct 28 08:43:20.914066 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 308/625] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:20 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:20.915794 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4ae41dc8-5ea7-4467-a1b3-c9052dc7e1b4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:20.916787 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4ae41dc8-5ea7-4467-a1b3-c9052dc7e1b4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:20.925035 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ae41dc8-5ea7-4467-a1b3-c9052dc7e1b4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:20.925474 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ae41dc8-5ea7-4467-a1b3-c9052dc7e1b4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:20.926278 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ae41dc8-5ea7-4467-a1b3-c9052dc7e1b4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:20.926926 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ae41dc8-5ea7-4467-a1b3-c9052dc7e1b4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:20.988316 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-88a40184-6e18-4a53-961b-2a16ffd22ce6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:20.998381 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4ae41dc8-5ea7-4467-a1b3-c9052dc7e1b4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.085889 Oct 28 08:43:20.999071 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 309/626] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:20 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:20.999518 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-88a40184-6e18-4a53-961b-2a16ffd22ce6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1568 microversion: 2.1 time: 0.160044 Oct 28 08:43:21.012756 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 318/627] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:20 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:43:21.922979 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-636a8849-49f2-4794-912a-4f0a1a1e58ed tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:21.923997 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-636a8849-49f2-4794-912a-4f0a1a1e58ed tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:21.930890 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-636a8849-49f2-4794-912a-4f0a1a1e58ed tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:21.931335 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-636a8849-49f2-4794-912a-4f0a1a1e58ed tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:21.932118 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-636a8849-49f2-4794-912a-4f0a1a1e58ed tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:21.932552 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-636a8849-49f2-4794-912a-4f0a1a1e58ed tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:22.009582 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b47fc10f-f16b-4f17-a033-761d721ccd29 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:22.010587 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b47fc10f-f16b-4f17-a033-761d721ccd29 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:22.020897 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b47fc10f-f16b-4f17-a033-761d721ccd29 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:22.021347 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b47fc10f-f16b-4f17-a033-761d721ccd29 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:22.022139 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b47fc10f-f16b-4f17-a033-761d721ccd29 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:22.022592 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b47fc10f-f16b-4f17-a033-761d721ccd29 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:22.035076 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-636a8849-49f2-4794-912a-4f0a1a1e58ed tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.116520 Oct 28 08:43:22.039154 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 310/628] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:21 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:22.044197 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d855e161-f0d3-44d4-873f-1b20185cc2e6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:22.044898 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d855e161-f0d3-44d4-873f-1b20185cc2e6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:22.052571 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d855e161-f0d3-44d4-873f-1b20185cc2e6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:22.053017 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d855e161-f0d3-44d4-873f-1b20185cc2e6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:22.053800 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d855e161-f0d3-44d4-873f-1b20185cc2e6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:22.054241 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d855e161-f0d3-44d4-873f-1b20185cc2e6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:22.193582 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-d855e161-f0d3-44d4-873f-1b20185cc2e6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:22.204042 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d855e161-f0d3-44d4-873f-1b20185cc2e6 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1568 microversion: 2.1 time: 0.163664 Oct 28 08:43:22.204928 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 311/629] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:22 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:22.210606 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b47fc10f-f16b-4f17-a033-761d721ccd29 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.204615 Oct 28 08:43:22.211462 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 319/630] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:22 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:23.047586 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c03e126e-5384-4f57-86ab-519ef492079d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:23.048523 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c03e126e-5384-4f57-86ab-519ef492079d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:23.054761 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c03e126e-5384-4f57-86ab-519ef492079d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:23.055197 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c03e126e-5384-4f57-86ab-519ef492079d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:23.055950 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c03e126e-5384-4f57-86ab-519ef492079d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:23.056429 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c03e126e-5384-4f57-86ab-519ef492079d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:23.137967 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c03e126e-5384-4f57-86ab-519ef492079d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.094543 Oct 28 08:43:23.138844 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 312/631] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:23 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:23.221355 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-38aa0060-6def-44f4-b7a6-6411157ee184 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:23.222305 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-38aa0060-6def-44f4-b7a6-6411157ee184 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:23.224534 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-35f7488f-ed2f-4540-8384-56c37d54a2f1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:23.225546 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-35f7488f-ed2f-4540-8384-56c37d54a2f1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:23.228956 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38aa0060-6def-44f4-b7a6-6411157ee184 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:23.229393 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38aa0060-6def-44f4-b7a6-6411157ee184 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:23.230345 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38aa0060-6def-44f4-b7a6-6411157ee184 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:23.231136 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38aa0060-6def-44f4-b7a6-6411157ee184 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:23.232506 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35f7488f-ed2f-4540-8384-56c37d54a2f1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:23.233085 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35f7488f-ed2f-4540-8384-56c37d54a2f1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:23.234227 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35f7488f-ed2f-4540-8384-56c37d54a2f1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:23.234592 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35f7488f-ed2f-4540-8384-56c37d54a2f1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:23.309861 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-35f7488f-ed2f-4540-8384-56c37d54a2f1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.089349 Oct 28 08:43:23.310562 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 313/632] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:23 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:23.319857 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1d6fd9df-1254-4e8d-b9e4-b42404b8f576 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:23.320489 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1d6fd9df-1254-4e8d-b9e4-b42404b8f576 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:23.328494 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d6fd9df-1254-4e8d-b9e4-b42404b8f576 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:23.328965 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d6fd9df-1254-4e8d-b9e4-b42404b8f576 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:23.329743 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d6fd9df-1254-4e8d-b9e4-b42404b8f576 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:23.330169 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d6fd9df-1254-4e8d-b9e4-b42404b8f576 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:23.361988 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-38aa0060-6def-44f4-b7a6-6411157ee184 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:23.370341 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-38aa0060-6def-44f4-b7a6-6411157ee184 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1568 microversion: 2.1 time: 0.152936 Oct 28 08:43:23.370940 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 320/633] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:23 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:23.412441 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-1d6fd9df-1254-4e8d-b9e4-b42404b8f576 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lazy-loading 'services' on Instance uuid 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:43:23.484991 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1d6fd9df-1254-4e8d-b9e4-b42404b8f576 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "DELETE /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061/os-volume_attachments/5e6a97a0-475c-4caf-b87e-a0e80d2d245d" status: 202 len: 0 microversion: 2.1 time: 0.173032 Oct 28 08:43:23.485554 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 314/634] 10.222.0.76 () {58 vars in 1415 bytes} [Thu Oct 28 08:43:23 2021] DELETE /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061/os-volume_attachments/5e6a97a0-475c-4caf-b87e-a0e80d2d245d => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:23.493879 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-61582a67-56b5-46d8-a48b-d725c846b209 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:23.494909 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-61582a67-56b5-46d8-a48b-d725c846b209 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:23.502312 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61582a67-56b5-46d8-a48b-d725c846b209 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:23.502797 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61582a67-56b5-46d8-a48b-d725c846b209 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:23.503574 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61582a67-56b5-46d8-a48b-d725c846b209 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:23.503999 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61582a67-56b5-46d8-a48b-d725c846b209 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:23.514043 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 08:43:23.514443 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: Thu Oct 28 08:43:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 08:43:23.547374 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-61582a67-56b5-46d8-a48b-d725c846b209 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057249 Oct 28 08:43:23.548060 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 321/635] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Oct 28 08:43:23 2021] GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:43:24.152635 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8ec51786-5180-4d8d-bdb8-63efc0d4ba7a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:24.153685 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8ec51786-5180-4d8d-bdb8-63efc0d4ba7a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:24.165437 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ec51786-5180-4d8d-bdb8-63efc0d4ba7a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:24.166346 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ec51786-5180-4d8d-bdb8-63efc0d4ba7a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:24.167336 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ec51786-5180-4d8d-bdb8-63efc0d4ba7a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:24.167774 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ec51786-5180-4d8d-bdb8-63efc0d4ba7a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:24.289834 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8ec51786-5180-4d8d-bdb8-63efc0d4ba7a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.142763 Oct 28 08:43:24.290742 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 315/636] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:24 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:24.323179 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a431c838-ae52-40fc-995b-85db0d283049 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:24.324063 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a431c838-ae52-40fc-995b-85db0d283049 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:24.333589 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a431c838-ae52-40fc-995b-85db0d283049 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:24.334151 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a431c838-ae52-40fc-995b-85db0d283049 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:24.335027 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a431c838-ae52-40fc-995b-85db0d283049 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:24.335720 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a431c838-ae52-40fc-995b-85db0d283049 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:24.388920 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5bb248d6-8b16-4f54-a016-be358fe940da tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:24.389508 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5bb248d6-8b16-4f54-a016-be358fe940da tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:24.397237 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bb248d6-8b16-4f54-a016-be358fe940da tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:24.397671 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bb248d6-8b16-4f54-a016-be358fe940da tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:24.398420 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bb248d6-8b16-4f54-a016-be358fe940da tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:24.398871 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bb248d6-8b16-4f54-a016-be358fe940da tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:24.418991 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a431c838-ae52-40fc-995b-85db0d283049 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.099570 Oct 28 08:43:24.419858 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 322/637] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:24 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:24.527706 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-5bb248d6-8b16-4f54-a016-be358fe940da tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:24.535955 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5bb248d6-8b16-4f54-a016-be358fe940da tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1568 microversion: 2.1 time: 0.151224 Oct 28 08:43:24.536517 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 316/638] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:24 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:43:24.560305 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-65a107c7-3854-4561-8d63-a1bdcefdaa81 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:24.561300 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-65a107c7-3854-4561-8d63-a1bdcefdaa81 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:24.568536 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65a107c7-3854-4561-8d63-a1bdcefdaa81 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:24.568978 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65a107c7-3854-4561-8d63-a1bdcefdaa81 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:24.569739 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65a107c7-3854-4561-8d63-a1bdcefdaa81 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:24.570176 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65a107c7-3854-4561-8d63-a1bdcefdaa81 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:24.607334 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-65a107c7-3854-4561-8d63-a1bdcefdaa81 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051367 Oct 28 08:43:24.607899 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 323/639] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Oct 28 08:43:24 2021] GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:43:25.302238 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-791fd95f-0149-4cce-a3e6-2dac06005296 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:25.303191 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-791fd95f-0149-4cce-a3e6-2dac06005296 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:25.309332 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-791fd95f-0149-4cce-a3e6-2dac06005296 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:25.309778 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-791fd95f-0149-4cce-a3e6-2dac06005296 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:25.310563 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-791fd95f-0149-4cce-a3e6-2dac06005296 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:25.311000 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-791fd95f-0149-4cce-a3e6-2dac06005296 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:25.391193 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-791fd95f-0149-4cce-a3e6-2dac06005296 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.092372 Oct 28 08:43:25.391835 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 317/640] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:25 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:25.430891 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-68569cda-965c-482a-b508-986525e0688e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:25.431816 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-68569cda-965c-482a-b508-986525e0688e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:25.438251 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-68569cda-965c-482a-b508-986525e0688e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:25.438735 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-68569cda-965c-482a-b508-986525e0688e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:25.439489 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-68569cda-965c-482a-b508-986525e0688e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:25.439913 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-68569cda-965c-482a-b508-986525e0688e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:25.509433 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-68569cda-965c-482a-b508-986525e0688e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.081972 Oct 28 08:43:25.510082 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 324/641] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:25 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:25.557498 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f22420fd-f2ab-417b-8ccd-6288bb9c89cf tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:25.558095 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f22420fd-f2ab-417b-8ccd-6288bb9c89cf tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:25.565452 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f22420fd-f2ab-417b-8ccd-6288bb9c89cf tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:25.565887 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f22420fd-f2ab-417b-8ccd-6288bb9c89cf tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:25.566667 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f22420fd-f2ab-417b-8ccd-6288bb9c89cf tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:25.567092 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f22420fd-f2ab-417b-8ccd-6288bb9c89cf tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:25.620101 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-22423492-9718-4cae-a697-0d703aa1c2f7 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:25.621089 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-22423492-9718-4cae-a697-0d703aa1c2f7 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:25.628387 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22423492-9718-4cae-a697-0d703aa1c2f7 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:25.628842 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22423492-9718-4cae-a697-0d703aa1c2f7 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:25.629609 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22423492-9718-4cae-a697-0d703aa1c2f7 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:25.630034 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22423492-9718-4cae-a697-0d703aa1c2f7 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:25.662471 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-22423492-9718-4cae-a697-0d703aa1c2f7 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046328 Oct 28 08:43:25.663053 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 325/642] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Oct 28 08:43:25 2021] GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 08:43:25.694283 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-f22420fd-f2ab-417b-8ccd-6288bb9c89cf tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:25.709446 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f22420fd-f2ab-417b-8ccd-6288bb9c89cf tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1568 microversion: 2.1 time: 0.149881 Oct 28 08:43:25.709446 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 318/643] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:25 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:26.403010 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ec33aa1c-6bef-420f-8c43-0dc71752afce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:26.403812 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ec33aa1c-6bef-420f-8c43-0dc71752afce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:26.410056 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ec33aa1c-6bef-420f-8c43-0dc71752afce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:26.410517 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ec33aa1c-6bef-420f-8c43-0dc71752afce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:26.411346 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ec33aa1c-6bef-420f-8c43-0dc71752afce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:26.411839 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ec33aa1c-6bef-420f-8c43-0dc71752afce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:26.494123 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ec33aa1c-6bef-420f-8c43-0dc71752afce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.094732 Oct 28 08:43:26.495018 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 326/644] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:26 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:26.521235 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-80c198df-281c-41c3-beff-2a6ca5c13d8e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:26.522150 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-80c198df-281c-41c3-beff-2a6ca5c13d8e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:26.528597 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80c198df-281c-41c3-beff-2a6ca5c13d8e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:26.529037 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80c198df-281c-41c3-beff-2a6ca5c13d8e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:26.529829 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80c198df-281c-41c3-beff-2a6ca5c13d8e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:26.530256 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80c198df-281c-41c3-beff-2a6ca5c13d8e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:26.598449 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-80c198df-281c-41c3-beff-2a6ca5c13d8e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.080673 Oct 28 08:43:26.599093 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 319/645] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:26 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:26.721954 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b5555b5f-3220-40ae-a1a1-a83972b2c74c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:26.722589 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b5555b5f-3220-40ae-a1a1-a83972b2c74c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:26.729522 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5555b5f-3220-40ae-a1a1-a83972b2c74c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:26.729973 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5555b5f-3220-40ae-a1a1-a83972b2c74c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:26.730789 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5555b5f-3220-40ae-a1a1-a83972b2c74c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:26.731220 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5555b5f-3220-40ae-a1a1-a83972b2c74c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:26.845776 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b4c98657-7d3e-402e-8ff1-02fe9f4bb30b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:26.846782 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b4c98657-7d3e-402e-8ff1-02fe9f4bb30b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:26.854052 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4c98657-7d3e-402e-8ff1-02fe9f4bb30b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:26.854604 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4c98657-7d3e-402e-8ff1-02fe9f4bb30b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:26.855480 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4c98657-7d3e-402e-8ff1-02fe9f4bb30b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:26.855954 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4c98657-7d3e-402e-8ff1-02fe9f4bb30b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:26.863103 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-b5555b5f-3220-40ae-a1a1-a83972b2c74c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:26.871366 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b5555b5f-3220-40ae-a1a1-a83972b2c74c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1568 microversion: 2.1 time: 0.154571 Oct 28 08:43:26.872216 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 327/646] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:26 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:26.883289 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b4c98657-7d3e-402e-8ff1-02fe9f4bb30b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:43:26.961227 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b4c98657-7d3e-402e-8ff1-02fe9f4bb30b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "DELETE /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061" status: 204 len: 0 microversion: 2.1 time: 0.119599 Oct 28 08:43:26.962761 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 320/647] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Oct 28 08:43:26 2021] DELETE /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:43:26.971034 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-15515e94-081a-4d13-988d-49b31b24b87c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:26.971890 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-15515e94-081a-4d13-988d-49b31b24b87c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:26.977799 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15515e94-081a-4d13-988d-49b31b24b87c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:26.978171 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15515e94-081a-4d13-988d-49b31b24b87c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:26.978981 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15515e94-081a-4d13-988d-49b31b24b87c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:26.979404 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15515e94-081a-4d13-988d-49b31b24b87c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:27.102275 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-15515e94-081a-4d13-988d-49b31b24b87c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:27.110879 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-15515e94-081a-4d13-988d-49b31b24b87c tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061" status: 200 len: 1514 microversion: 2.1 time: 0.143987 Oct 28 08:43:27.111465 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 328/648] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:26 2021] GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061 => generated 1514 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:27.506323 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-32670557-3197-4f9f-b5ae-6632706ef379 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:27.507409 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-32670557-3197-4f9f-b5ae-6632706ef379 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:27.513578 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-32670557-3197-4f9f-b5ae-6632706ef379 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:27.514025 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-32670557-3197-4f9f-b5ae-6632706ef379 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:27.514899 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-32670557-3197-4f9f-b5ae-6632706ef379 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:27.515381 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-32670557-3197-4f9f-b5ae-6632706ef379 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:27.582283 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-32670557-3197-4f9f-b5ae-6632706ef379 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.079852 Oct 28 08:43:27.582992 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 321/649] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:27 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:27.611029 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b1b60cb9-b1bd-4c71-ba27-baee4f3eb72e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:27.611964 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b1b60cb9-b1bd-4c71-ba27-baee4f3eb72e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:27.618083 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1b60cb9-b1bd-4c71-ba27-baee4f3eb72e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:27.618540 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1b60cb9-b1bd-4c71-ba27-baee4f3eb72e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:27.619377 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1b60cb9-b1bd-4c71-ba27-baee4f3eb72e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:27.619717 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1b60cb9-b1bd-4c71-ba27-baee4f3eb72e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:27.697313 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b1b60cb9-b1bd-4c71-ba27-baee4f3eb72e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.090989 Oct 28 08:43:27.698591 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 329/650] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:27 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:27.889640 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e29de886-e352-47ec-a36c-28df24768c2f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:27.890243 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e29de886-e352-47ec-a36c-28df24768c2f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:27.897131 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e29de886-e352-47ec-a36c-28df24768c2f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:27.897578 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e29de886-e352-47ec-a36c-28df24768c2f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:27.898346 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e29de886-e352-47ec-a36c-28df24768c2f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:27.898817 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e29de886-e352-47ec-a36c-28df24768c2f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:28.025990 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-e29de886-e352-47ec-a36c-28df24768c2f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:28.034956 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e29de886-e352-47ec-a36c-28df24768c2f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1568 microversion: 2.1 time: 0.149493 Oct 28 08:43:28.035506 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 322/651] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:27 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:28.129327 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0167e8fb-a287-438c-a698-508f66d77f75 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:28.130066 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0167e8fb-a287-438c-a698-508f66d77f75 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:28.137069 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0167e8fb-a287-438c-a698-508f66d77f75 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:28.137505 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0167e8fb-a287-438c-a698-508f66d77f75 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:28.138278 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0167e8fb-a287-438c-a698-508f66d77f75 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:28.138873 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0167e8fb-a287-438c-a698-508f66d77f75 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:28.271082 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-0167e8fb-a287-438c-a698-508f66d77f75 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:28.279160 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0167e8fb-a287-438c-a698-508f66d77f75 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061" status: 200 len: 1514 microversion: 2.1 time: 0.154457 Oct 28 08:43:28.279732 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 330/652] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:28 2021] GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:28.593563 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dfcf95f8-e7f0-446f-be4e-93b358d4b47f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:28.594472 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dfcf95f8-e7f0-446f-be4e-93b358d4b47f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:28.601097 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dfcf95f8-e7f0-446f-be4e-93b358d4b47f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:28.601540 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dfcf95f8-e7f0-446f-be4e-93b358d4b47f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:28.602305 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dfcf95f8-e7f0-446f-be4e-93b358d4b47f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:28.602768 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dfcf95f8-e7f0-446f-be4e-93b358d4b47f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:28.698790 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dfcf95f8-e7f0-446f-be4e-93b358d4b47f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.108740 Oct 28 08:43:28.699518 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 323/653] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:28 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:28.709370 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c1c796cf-2fa0-4ee3-9e21-68a383a3d5cf tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:28.710315 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c1c796cf-2fa0-4ee3-9e21-68a383a3d5cf tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:28.716586 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c1c796cf-2fa0-4ee3-9e21-68a383a3d5cf tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:28.717027 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c1c796cf-2fa0-4ee3-9e21-68a383a3d5cf tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:28.717788 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c1c796cf-2fa0-4ee3-9e21-68a383a3d5cf tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:28.718235 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c1c796cf-2fa0-4ee3-9e21-68a383a3d5cf tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:28.798337 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c1c796cf-2fa0-4ee3-9e21-68a383a3d5cf tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.092389 Oct 28 08:43:28.799019 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 331/654] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:28 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:29.052893 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d6cb8053-12a1-4a90-85d7-4081f0c4593e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:29.053579 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d6cb8053-12a1-4a90-85d7-4081f0c4593e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:29.060670 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6cb8053-12a1-4a90-85d7-4081f0c4593e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:29.061106 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6cb8053-12a1-4a90-85d7-4081f0c4593e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:29.061955 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6cb8053-12a1-4a90-85d7-4081f0c4593e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:29.063164 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6cb8053-12a1-4a90-85d7-4081f0c4593e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:29.190049 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-d6cb8053-12a1-4a90-85d7-4081f0c4593e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:29.198061 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d6cb8053-12a1-4a90-85d7-4081f0c4593e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1568 microversion: 2.1 time: 0.149100 Oct 28 08:43:29.198652 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 324/655] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:29 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:29.298993 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5b4b0f83-fb57-4228-994b-601ade2c0867 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:29.299694 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5b4b0f83-fb57-4228-994b-601ade2c0867 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:29.307405 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b4b0f83-fb57-4228-994b-601ade2c0867 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:29.308112 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b4b0f83-fb57-4228-994b-601ade2c0867 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:29.308898 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b4b0f83-fb57-4228-994b-601ade2c0867 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:29.309329 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b4b0f83-fb57-4228-994b-601ade2c0867 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:29.445010 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-5b4b0f83-fb57-4228-994b-601ade2c0867 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:29.453506 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5b4b0f83-fb57-4228-994b-601ade2c0867 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061" status: 200 len: 1514 microversion: 2.1 time: 0.159426 Oct 28 08:43:29.454078 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 332/656] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:29 2021] GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:29.710005 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0f34294b-3c57-4b8b-b003-fd83dbbbbed8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:29.710854 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0f34294b-3c57-4b8b-b003-fd83dbbbbed8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:29.717066 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f34294b-3c57-4b8b-b003-fd83dbbbbed8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:29.717503 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f34294b-3c57-4b8b-b003-fd83dbbbbed8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:29.719037 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f34294b-3c57-4b8b-b003-fd83dbbbbed8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:29.720052 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f34294b-3c57-4b8b-b003-fd83dbbbbed8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:29.811279 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6573df2f-e0bc-492a-88a1-a867428aa75c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:29.812322 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6573df2f-e0bc-492a-88a1-a867428aa75c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:29.820371 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6573df2f-e0bc-492a-88a1-a867428aa75c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:29.820958 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6573df2f-e0bc-492a-88a1-a867428aa75c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:29.821745 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6573df2f-e0bc-492a-88a1-a867428aa75c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:29.822160 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6573df2f-e0bc-492a-88a1-a867428aa75c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:29.823166 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0f34294b-3c57-4b8b-b003-fd83dbbbbed8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.116727 Oct 28 08:43:29.823863 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 325/657] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:29 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:29.914252 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6573df2f-e0bc-492a-88a1-a867428aa75c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.108398 Oct 28 08:43:29.917615 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 333/658] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:29 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:30.217253 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0b1f7699-a169-4b93-b5cc-ca3341a80d4d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:30.217957 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0b1f7699-a169-4b93-b5cc-ca3341a80d4d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:30.225645 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b1f7699-a169-4b93-b5cc-ca3341a80d4d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:30.226135 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b1f7699-a169-4b93-b5cc-ca3341a80d4d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:30.226941 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b1f7699-a169-4b93-b5cc-ca3341a80d4d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:30.227375 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b1f7699-a169-4b93-b5cc-ca3341a80d4d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:30.339429 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-390dd52d-c7f4-433d-88a9-e6776511a3ac req-2e10f949-98fb-4589-a530-9e8b6c62d6b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061", "name": "network-vif-deleted", "tag": "e663ba98-a487-4b76-8d8a-8e9f0d155ccc"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:30.340875 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:43:30.340875 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:43:30.351394 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-390dd52d-c7f4-433d-88a9-e6776511a3ac req-2e10f949-98fb-4589-a530-9e8b6c62d6b2 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:30.351821 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-390dd52d-c7f4-433d-88a9-e6776511a3ac req-2e10f949-98fb-4589-a530-9e8b6c62d6b2 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:30.365396 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-390dd52d-c7f4-433d-88a9-e6776511a3ac req-2e10f949-98fb-4589-a530-9e8b6c62d6b2 service nova] Creating event network-vif-deleted:e663ba98-a487-4b76-8d8a-8e9f0d155ccc for instance 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061 on hv-cinder-81565 Oct 28 08:43:30.371359 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-390dd52d-c7f4-433d-88a9-e6776511a3ac req-2e10f949-98fb-4589-a530-9e8b6c62d6b2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036321 Oct 28 08:43:30.372427 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 334/659] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:43:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:43:30.404534 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-0b1f7699-a169-4b93-b5cc-ca3341a80d4d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:30.413577 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0b1f7699-a169-4b93-b5cc-ca3341a80d4d tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1568 microversion: 2.1 time: 0.200380 Oct 28 08:43:30.414152 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 326/660] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:30 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:43:30.477185 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d183a220-e086-4b68-b7f8-46d400e4a908 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:30.477875 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d183a220-e086-4b68-b7f8-46d400e4a908 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:30.485809 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d183a220-e086-4b68-b7f8-46d400e4a908 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:30.486545 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d183a220-e086-4b68-b7f8-46d400e4a908 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:30.486943 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d183a220-e086-4b68-b7f8-46d400e4a908 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:30.487366 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d183a220-e086-4b68-b7f8-46d400e4a908 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:30.522620 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d183a220-e086-4b68-b7f8-46d400e4a908 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:30.523573 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d183a220-e086-4b68-b7f8-46d400e4a908 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:30.523698 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-d183a220-e086-4b68-b7f8-46d400e4a908 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lazy-loading 'fault' on Instance uuid 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:43:30.566143 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-d183a220-e086-4b68-b7f8-46d400e4a908 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:30.573540 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d183a220-e086-4b68-b7f8-46d400e4a908 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061" status: 200 len: 1308 microversion: 2.1 time: 0.106225 Oct 28 08:43:30.574150 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 335/661] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:30 2021] GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061 => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:43:30.833962 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4010cb27-e22a-4154-b2d2-a4ed2466a8d5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:30.835057 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4010cb27-e22a-4154-b2d2-a4ed2466a8d5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:30.841730 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4010cb27-e22a-4154-b2d2-a4ed2466a8d5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:30.842321 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4010cb27-e22a-4154-b2d2-a4ed2466a8d5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:30.843805 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4010cb27-e22a-4154-b2d2-a4ed2466a8d5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:30.844415 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4010cb27-e22a-4154-b2d2-a4ed2466a8d5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:30.931127 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e86b1129-d27f-4e1c-8933-3c6e0522ee00 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:30.932050 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e86b1129-d27f-4e1c-8933-3c6e0522ee00 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:30.939885 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e86b1129-d27f-4e1c-8933-3c6e0522ee00 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:30.940322 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e86b1129-d27f-4e1c-8933-3c6e0522ee00 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:30.941118 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e86b1129-d27f-4e1c-8933-3c6e0522ee00 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:30.941539 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e86b1129-d27f-4e1c-8933-3c6e0522ee00 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:30.985337 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4010cb27-e22a-4154-b2d2-a4ed2466a8d5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.151237 Oct 28 08:43:30.985985 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 327/662] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:30 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:31.027861 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e86b1129-d27f-4e1c-8933-3c6e0522ee00 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.106071 Oct 28 08:43:31.028692 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 336/663] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:30 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:31.431677 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-db48c04d-eaf4-41e1-a383-647ec9d2ef03 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:31.432405 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-db48c04d-eaf4-41e1-a383-647ec9d2ef03 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:31.439392 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db48c04d-eaf4-41e1-a383-647ec9d2ef03 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:31.439820 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db48c04d-eaf4-41e1-a383-647ec9d2ef03 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:31.440587 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db48c04d-eaf4-41e1-a383-647ec9d2ef03 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:31.441020 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db48c04d-eaf4-41e1-a383-647ec9d2ef03 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:31.570010 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-db48c04d-eaf4-41e1-a383-647ec9d2ef03 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:31.578954 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-db48c04d-eaf4-41e1-a383-647ec9d2ef03 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1568 microversion: 2.1 time: 0.151238 Oct 28 08:43:31.579517 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 328/664] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:31 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:31.590819 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-306005a7-3ba7-4765-a7f2-b147a42ffead tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:31.591499 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-306005a7-3ba7-4765-a7f2-b147a42ffead tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:31.599081 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-306005a7-3ba7-4765-a7f2-b147a42ffead tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:31.599516 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-306005a7-3ba7-4765-a7f2-b147a42ffead tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:31.600266 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-306005a7-3ba7-4765-a7f2-b147a42ffead tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:31.600680 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-306005a7-3ba7-4765-a7f2-b147a42ffead tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:31.615012 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-306005a7-3ba7-4765-a7f2-b147a42ffead tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] HTTP exception thrown: Instance 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061 could not be found. Oct 28 08:43:31.615584 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-306005a7-3ba7-4765-a7f2-b147a42ffead tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Returning 404 to user: Instance 2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:43:31.616391 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-306005a7-3ba7-4765-a7f2-b147a42ffead tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061" status: 404 len: 111 microversion: 2.1 time: 0.029603 Oct 28 08:43:31.616910 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 337/665] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:31 2021] GET /compute/v2.1/servers/2b7d75c8-1ca7-40dd-bf01-3d92f5eb7061 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:43:31.996509 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a863d9f6-7227-4621-afb5-a82576d4c440 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:31.997339 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a863d9f6-7227-4621-afb5-a82576d4c440 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:32.004392 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a863d9f6-7227-4621-afb5-a82576d4c440 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:32.004842 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a863d9f6-7227-4621-afb5-a82576d4c440 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:32.005610 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a863d9f6-7227-4621-afb5-a82576d4c440 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:32.006043 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a863d9f6-7227-4621-afb5-a82576d4c440 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:32.040005 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-44d646f9-5df4-431b-9841-17c32ae5969c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:32.040907 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-44d646f9-5df4-431b-9841-17c32ae5969c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:32.047862 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44d646f9-5df4-431b-9841-17c32ae5969c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:32.048303 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44d646f9-5df4-431b-9841-17c32ae5969c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:32.049069 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44d646f9-5df4-431b-9841-17c32ae5969c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:32.049493 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44d646f9-5df4-431b-9841-17c32ae5969c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:32.074888 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a863d9f6-7227-4621-afb5-a82576d4c440 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.082080 Oct 28 08:43:32.076911 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 329/666] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:31 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:32.124314 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-44d646f9-5df4-431b-9841-17c32ae5969c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.087783 Oct 28 08:43:32.125880 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 338/667] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:32 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:32.595286 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-800e1124-8d0a-41e9-a17d-cde54eff0b17 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:32.596035 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-800e1124-8d0a-41e9-a17d-cde54eff0b17 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:32.603387 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-800e1124-8d0a-41e9-a17d-cde54eff0b17 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:32.603833 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-800e1124-8d0a-41e9-a17d-cde54eff0b17 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:32.604598 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-800e1124-8d0a-41e9-a17d-cde54eff0b17 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:32.605032 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-800e1124-8d0a-41e9-a17d-cde54eff0b17 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:32.729564 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-800e1124-8d0a-41e9-a17d-cde54eff0b17 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:32.739949 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-800e1124-8d0a-41e9-a17d-cde54eff0b17 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1568 microversion: 2.1 time: 0.148575 Oct 28 08:43:32.740539 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 330/668] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:32 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:32.751640 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b7e25652-7c0a-401e-a380-f7e1df5b9afe tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:32.752221 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b7e25652-7c0a-401e-a380-f7e1df5b9afe tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:32.758983 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7e25652-7c0a-401e-a380-f7e1df5b9afe tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:32.759421 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7e25652-7c0a-401e-a380-f7e1df5b9afe tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:32.760180 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7e25652-7c0a-401e-a380-f7e1df5b9afe tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:32.760640 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7e25652-7c0a-401e-a380-f7e1df5b9afe tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:32.785053 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b7e25652-7c0a-401e-a380-f7e1df5b9afe tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:43:32.860977 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b7e25652-7c0a-401e-a380-f7e1df5b9afe tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "DELETE /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 204 len: 0 microversion: 2.1 time: 0.113917 Oct 28 08:43:32.861603 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 339/669] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Oct 28 08:43:32 2021] DELETE /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:43:32.870020 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d51fbc8a-f6c0-49ea-bcd7-3b201b4b9493 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:32.870659 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d51fbc8a-f6c0-49ea-bcd7-3b201b4b9493 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:32.877622 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d51fbc8a-f6c0-49ea-bcd7-3b201b4b9493 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:32.878062 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d51fbc8a-f6c0-49ea-bcd7-3b201b4b9493 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:32.878885 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d51fbc8a-f6c0-49ea-bcd7-3b201b4b9493 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:32.879313 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d51fbc8a-f6c0-49ea-bcd7-3b201b4b9493 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:33.000535 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-d51fbc8a-f6c0-49ea-bcd7-3b201b4b9493 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:33.007912 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d51fbc8a-f6c0-49ea-bcd7-3b201b4b9493 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1514 microversion: 2.1 time: 0.141620 Oct 28 08:43:33.008472 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 331/670] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:32 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1514 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:43:33.088186 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f9d2aeba-e4c2-4aa4-9cc7-04412064f5a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:33.089206 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f9d2aeba-e4c2-4aa4-9cc7-04412064f5a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:33.096591 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9d2aeba-e4c2-4aa4-9cc7-04412064f5a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:33.097033 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9d2aeba-e4c2-4aa4-9cc7-04412064f5a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:33.097804 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9d2aeba-e4c2-4aa4-9cc7-04412064f5a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:33.098237 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9d2aeba-e4c2-4aa4-9cc7-04412064f5a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:33.136729 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cbeccee1-4371-4f58-a51a-f83951aec7db tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:33.137702 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cbeccee1-4371-4f58-a51a-f83951aec7db tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:33.144274 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cbeccee1-4371-4f58-a51a-f83951aec7db tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:33.144722 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cbeccee1-4371-4f58-a51a-f83951aec7db tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:33.145522 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cbeccee1-4371-4f58-a51a-f83951aec7db tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:33.145956 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cbeccee1-4371-4f58-a51a-f83951aec7db tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:33.163973 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f9d2aeba-e4c2-4aa4-9cc7-04412064f5a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.079717 Oct 28 08:43:33.165104 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 340/671] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:33 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:43:33.211200 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cbeccee1-4371-4f58-a51a-f83951aec7db tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.077793 Oct 28 08:43:33.211750 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 332/672] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:33 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:33.757511 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cdccb582-e510-4659-abb0-664145fc04d4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:33.758192 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cdccb582-e510-4659-abb0-664145fc04d4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:33.765045 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cdccb582-e510-4659-abb0-664145fc04d4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:33.765483 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cdccb582-e510-4659-abb0-664145fc04d4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:33.766764 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cdccb582-e510-4659-abb0-664145fc04d4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:33.767193 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cdccb582-e510-4659-abb0-664145fc04d4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:33.925132 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-cdccb582-e510-4659-abb0-664145fc04d4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:33.933016 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cdccb582-e510-4659-abb0-664145fc04d4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1568 microversion: 2.1 time: 0.179559 Oct 28 08:43:33.933624 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 341/673] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:33 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:34.025847 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8d70ff76-4952-405c-b129-27c466ef9fd5 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:34.026568 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8d70ff76-4952-405c-b129-27c466ef9fd5 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:34.033514 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d70ff76-4952-405c-b129-27c466ef9fd5 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:34.033960 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d70ff76-4952-405c-b129-27c466ef9fd5 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:34.034756 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d70ff76-4952-405c-b129-27c466ef9fd5 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:34.035192 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d70ff76-4952-405c-b129-27c466ef9fd5 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:34.161296 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-8d70ff76-4952-405c-b129-27c466ef9fd5 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:34.168620 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8d70ff76-4952-405c-b129-27c466ef9fd5 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1514 microversion: 2.1 time: 0.146806 Oct 28 08:43:34.169186 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 333/674] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:34 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:34.176217 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a33245b2-3672-4ed3-9434-79d5676d6333 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:34.177287 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a33245b2-3672-4ed3-9434-79d5676d6333 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:34.183517 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a33245b2-3672-4ed3-9434-79d5676d6333 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:34.183971 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a33245b2-3672-4ed3-9434-79d5676d6333 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:34.184710 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a33245b2-3672-4ed3-9434-79d5676d6333 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:34.185134 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a33245b2-3672-4ed3-9434-79d5676d6333 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:34.222637 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f56d7369-8aaf-4661-8185-1c5bce80eb2c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:34.223574 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f56d7369-8aaf-4661-8185-1c5bce80eb2c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:34.229343 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f56d7369-8aaf-4661-8185-1c5bce80eb2c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:34.229784 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f56d7369-8aaf-4661-8185-1c5bce80eb2c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:34.230570 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f56d7369-8aaf-4661-8185-1c5bce80eb2c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:34.231001 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f56d7369-8aaf-4661-8185-1c5bce80eb2c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:34.303953 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a33245b2-3672-4ed3-9434-79d5676d6333 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.131889 Oct 28 08:43:34.304741 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 342/675] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:34 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:34.309135 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f56d7369-8aaf-4661-8185-1c5bce80eb2c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.090411 Oct 28 08:43:34.309755 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 334/676] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:34 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:34.951437 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d0ac2de0-a3e7-4e60-ad4f-8a495e625e35 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:34.952128 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d0ac2de0-a3e7-4e60-ad4f-8a495e625e35 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:34.959489 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d0ac2de0-a3e7-4e60-ad4f-8a495e625e35 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:34.959936 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d0ac2de0-a3e7-4e60-ad4f-8a495e625e35 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:34.960698 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d0ac2de0-a3e7-4e60-ad4f-8a495e625e35 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:34.961131 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d0ac2de0-a3e7-4e60-ad4f-8a495e625e35 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:35.094483 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-d0ac2de0-a3e7-4e60-ad4f-8a495e625e35 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:35.102693 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d0ac2de0-a3e7-4e60-ad4f-8a495e625e35 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1568 microversion: 2.1 time: 0.155853 Oct 28 08:43:35.103256 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 343/677] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:34 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:43:35.185338 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ab63a3b2-5989-4ab0-94cf-9807f1bfc524 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:35.186021 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ab63a3b2-5989-4ab0-94cf-9807f1bfc524 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:35.193046 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab63a3b2-5989-4ab0-94cf-9807f1bfc524 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:35.193485 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab63a3b2-5989-4ab0-94cf-9807f1bfc524 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:35.194249 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab63a3b2-5989-4ab0-94cf-9807f1bfc524 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:35.194709 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab63a3b2-5989-4ab0-94cf-9807f1bfc524 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:35.316078 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3f88b9cd-73f1-43a6-8578-85e14126909c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:35.317729 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3f88b9cd-73f1-43a6-8578-85e14126909c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:35.318194 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-ab63a3b2-5989-4ab0-94cf-9807f1bfc524 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:35.324165 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f88b9cd-73f1-43a6-8578-85e14126909c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:35.324608 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f88b9cd-73f1-43a6-8578-85e14126909c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:35.325379 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f88b9cd-73f1-43a6-8578-85e14126909c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:35.325809 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f88b9cd-73f1-43a6-8578-85e14126909c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:35.326250 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ab63a3b2-5989-4ab0-94cf-9807f1bfc524 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1514 microversion: 2.1 time: 0.144862 Oct 28 08:43:35.326856 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 335/678] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:35 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1514 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:35.332281 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-27d6001d-5d78-4a18-94f3-0f3b26d765b0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:35.333193 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-27d6001d-5d78-4a18-94f3-0f3b26d765b0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:35.339135 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27d6001d-5d78-4a18-94f3-0f3b26d765b0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:35.339578 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27d6001d-5d78-4a18-94f3-0f3b26d765b0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:35.340379 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27d6001d-5d78-4a18-94f3-0f3b26d765b0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:35.340814 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27d6001d-5d78-4a18-94f3-0f3b26d765b0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:35.438482 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-27d6001d-5d78-4a18-94f3-0f3b26d765b0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.110197 Oct 28 08:43:35.439236 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 336/679] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:35 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:35.449200 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3f88b9cd-73f1-43a6-8578-85e14126909c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.137106 Oct 28 08:43:35.449835 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 344/680] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:35 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:43:36.120685 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c9d989ff-7c81-43a2-998e-d9e5a1d0605c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:36.121384 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c9d989ff-7c81-43a2-998e-d9e5a1d0605c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:36.128425 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9d989ff-7c81-43a2-998e-d9e5a1d0605c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:36.128869 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9d989ff-7c81-43a2-998e-d9e5a1d0605c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:36.129634 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9d989ff-7c81-43a2-998e-d9e5a1d0605c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:36.130064 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9d989ff-7c81-43a2-998e-d9e5a1d0605c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:36.249887 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c9d989ff-7c81-43a2-998e-d9e5a1d0605c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:36.257648 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c9d989ff-7c81-43a2-998e-d9e5a1d0605c tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1568 microversion: 2.1 time: 0.140983 Oct 28 08:43:36.258228 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 337/681] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:36 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:36.344870 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4fe033ae-1e71-4d4e-8b6d-9395e3b6cd7b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:36.345924 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4fe033ae-1e71-4d4e-8b6d-9395e3b6cd7b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:36.353230 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4fe033ae-1e71-4d4e-8b6d-9395e3b6cd7b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:36.353905 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4fe033ae-1e71-4d4e-8b6d-9395e3b6cd7b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:36.354709 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4fe033ae-1e71-4d4e-8b6d-9395e3b6cd7b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:36.355130 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4fe033ae-1e71-4d4e-8b6d-9395e3b6cd7b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:36.449176 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-40bbaddc-aab3-48dc-823c-2d2114475a15 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:36.450746 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-40bbaddc-aab3-48dc-823c-2d2114475a15 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:36.457676 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40bbaddc-aab3-48dc-823c-2d2114475a15 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:36.458118 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40bbaddc-aab3-48dc-823c-2d2114475a15 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:36.459108 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40bbaddc-aab3-48dc-823c-2d2114475a15 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:36.459547 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40bbaddc-aab3-48dc-823c-2d2114475a15 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:36.524419 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-40bbaddc-aab3-48dc-823c-2d2114475a15 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.078725 Oct 28 08:43:36.528690 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 338/682] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:36 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:36.530317 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-98dd38d1-27ab-42af-9f2b-a224ee654960 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:36.532033 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-98dd38d1-27ab-42af-9f2b-a224ee654960 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:36.538948 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98dd38d1-27ab-42af-9f2b-a224ee654960 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:36.539393 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98dd38d1-27ab-42af-9f2b-a224ee654960 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:36.540195 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98dd38d1-27ab-42af-9f2b-a224ee654960 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:36.540770 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98dd38d1-27ab-42af-9f2b-a224ee654960 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:36.565955 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-4fe033ae-1e71-4d4e-8b6d-9395e3b6cd7b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:36.573418 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4fe033ae-1e71-4d4e-8b6d-9395e3b6cd7b tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1514 microversion: 2.1 time: 0.233255 Oct 28 08:43:36.573979 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 345/683] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:36 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1514 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:36.602088 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-98dd38d1-27ab-42af-9f2b-a224ee654960 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.075336 Oct 28 08:43:36.603007 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 339/684] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:36 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:37.148145 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-f56a0567-488b-4440-8c50-a4db802352c4 req-80c9a3a1-0c51-4138-b88e-84bc4fd8d7f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "174ae5e4-f21b-4141-88bf-98e7d5efb161", "name": "network-vif-deleted", "tag": "959d849c-17d9-4e15-b426-749af75d8b93"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:37.149624 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:43:37.149624 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:43:37.158160 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f56a0567-488b-4440-8c50-a4db802352c4 req-80c9a3a1-0c51-4138-b88e-84bc4fd8d7f4 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:37.158643 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f56a0567-488b-4440-8c50-a4db802352c4 req-80c9a3a1-0c51-4138-b88e-84bc4fd8d7f4 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:37.169452 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-f56a0567-488b-4440-8c50-a4db802352c4 req-80c9a3a1-0c51-4138-b88e-84bc4fd8d7f4 service nova] Creating event network-vif-deleted:959d849c-17d9-4e15-b426-749af75d8b93 for instance 174ae5e4-f21b-4141-88bf-98e7d5efb161 on hv-cinder-81565 Oct 28 08:43:37.175257 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-f56a0567-488b-4440-8c50-a4db802352c4 req-80c9a3a1-0c51-4138-b88e-84bc4fd8d7f4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030520 Oct 28 08:43:37.176095 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 346/685] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:43:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:43:37.275567 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7db8a938-952c-4978-8909-43dec40f692f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:37.276847 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7db8a938-952c-4978-8909-43dec40f692f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:37.284053 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7db8a938-952c-4978-8909-43dec40f692f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:37.284512 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7db8a938-952c-4978-8909-43dec40f692f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:37.285282 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7db8a938-952c-4978-8909-43dec40f692f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:37.285705 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7db8a938-952c-4978-8909-43dec40f692f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:37.410241 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-7db8a938-952c-4978-8909-43dec40f692f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:37.418554 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7db8a938-952c-4978-8909-43dec40f692f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1548 microversion: 2.1 time: 0.147534 Oct 28 08:43:37.419119 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 340/686] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:37 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:37.436032 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d3f8f3e8-e4fe-4565-a011-eed2c557a94a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:37.436599 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d3f8f3e8-e4fe-4565-a011-eed2c557a94a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:37.443582 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3f8f3e8-e4fe-4565-a011-eed2c557a94a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:37.444020 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3f8f3e8-e4fe-4565-a011-eed2c557a94a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:37.444771 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3f8f3e8-e4fe-4565-a011-eed2c557a94a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:37.445195 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3f8f3e8-e4fe-4565-a011-eed2c557a94a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:37.522654 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-d3f8f3e8-e4fe-4565-a011-eed2c557a94a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] HTTP exception thrown: Cannot 'detach_volume' instance a432ca47-c48c-4e08-8b76-0025d9ef360b while it is in vm_state rescued Oct 28 08:43:37.523333 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d3f8f3e8-e4fe-4565-a011-eed2c557a94a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Returning 409 to user: Cannot 'detach_volume' instance a432ca47-c48c-4e08-8b76-0025d9ef360b while it is in vm_state rescued {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:43:37.524234 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d3f8f3e8-e4fe-4565-a011-eed2c557a94a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "DELETE /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b/os-volume_attachments/f0213758-2f10-44cc-abde-eb942d226cf8" status: 409 len: 152 microversion: 2.1 time: 0.092751 Oct 28 08:43:37.524858 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 347/687] 10.222.0.76 () {58 vars in 1415 bytes} [Thu Oct 28 08:43:37 2021] DELETE /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b/os-volume_attachments/f0213758-2f10-44cc-abde-eb942d226cf8 => generated 152 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 08:43:37.533824 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-424e6682-6402-435b-b113-57c5d930d757 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:37.534613 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-424e6682-6402-435b-b113-57c5d930d757 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:37.536345 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eaaef386-88ad-4c8b-ad75-8feb5eed212b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:37.537307 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eaaef386-88ad-4c8b-ad75-8feb5eed212b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:37.540883 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-424e6682-6402-435b-b113-57c5d930d757 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:37.541336 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-424e6682-6402-435b-b113-57c5d930d757 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:37.542113 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-424e6682-6402-435b-b113-57c5d930d757 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:37.542567 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-424e6682-6402-435b-b113-57c5d930d757 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:37.544224 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eaaef386-88ad-4c8b-ad75-8feb5eed212b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:37.544704 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eaaef386-88ad-4c8b-ad75-8feb5eed212b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:37.545474 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eaaef386-88ad-4c8b-ad75-8feb5eed212b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:37.545908 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eaaef386-88ad-4c8b-ad75-8feb5eed212b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:37.618938 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-424e6682-6402-435b-b113-57c5d930d757 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "POST /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b/action" status: 202 len: 0 microversion: 2.1 time: 0.089200 Oct 28 08:43:37.622788 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 341/688] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:37 2021] POST /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:37.626368 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ba3816a8-1806-48f2-b4aa-12e3d02f66c8 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:37.627094 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ba3816a8-1806-48f2-b4aa-12e3d02f66c8 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:37.633617 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba3816a8-1806-48f2-b4aa-12e3d02f66c8 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:37.634164 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba3816a8-1806-48f2-b4aa-12e3d02f66c8 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:37.635099 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba3816a8-1806-48f2-b4aa-12e3d02f66c8 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:37.635454 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba3816a8-1806-48f2-b4aa-12e3d02f66c8 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:37.674134 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba3816a8-1806-48f2-b4aa-12e3d02f66c8 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:37.674607 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba3816a8-1806-48f2-b4aa-12e3d02f66c8 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:37.675063 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-ba3816a8-1806-48f2-b4aa-12e3d02f66c8 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lazy-loading 'fault' on Instance uuid 174ae5e4-f21b-4141-88bf-98e7d5efb161 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:43:37.727579 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-ba3816a8-1806-48f2-b4aa-12e3d02f66c8 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:37.734176 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ba3816a8-1806-48f2-b4aa-12e3d02f66c8 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 200 len: 1308 microversion: 2.1 time: 0.113538 Oct 28 08:43:37.737420 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 342/689] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:37 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 1308 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:37.741556 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c45194fb-c8c6-401e-9b7c-dba678ba7e9e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:37.741716 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eaaef386-88ad-4c8b-ad75-8feb5eed212b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.208596 Oct 28 08:43:37.745993 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 348/690] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:37 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:37.746148 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c45194fb-c8c6-401e-9b7c-dba678ba7e9e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:37.750601 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-92e35f07-71f9-4348-b11d-c9ba08feddfd tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:37.751340 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-92e35f07-71f9-4348-b11d-c9ba08feddfd tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:37.755412 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c45194fb-c8c6-401e-9b7c-dba678ba7e9e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:37.755856 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c45194fb-c8c6-401e-9b7c-dba678ba7e9e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:37.757259 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c45194fb-c8c6-401e-9b7c-dba678ba7e9e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:37.757698 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c45194fb-c8c6-401e-9b7c-dba678ba7e9e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:37.760070 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92e35f07-71f9-4348-b11d-c9ba08feddfd tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:37.760598 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92e35f07-71f9-4348-b11d-c9ba08feddfd tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:37.761456 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92e35f07-71f9-4348-b11d-c9ba08feddfd tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:37.762054 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92e35f07-71f9-4348-b11d-c9ba08feddfd tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:37.825010 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c45194fb-c8c6-401e-9b7c-dba678ba7e9e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.087611 Oct 28 08:43:37.825922 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 343/691] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:37 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:37.966518 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-92e35f07-71f9-4348-b11d-c9ba08feddfd tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:37.975376 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-92e35f07-71f9-4348-b11d-c9ba08feddfd tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1556 microversion: 2.1 time: 0.231903 Oct 28 08:43:37.975982 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 349/692] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:37 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1556 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:38.754721 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c49431fa-72da-455d-8116-b5b4df2f4646 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:38.755726 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c49431fa-72da-455d-8116-b5b4df2f4646 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:38.755859 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-965ac17e-8570-4cf2-8d13-f53f81d982fb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:38.756394 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-965ac17e-8570-4cf2-8d13-f53f81d982fb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 174ae5e4-f21b-4141-88bf-98e7d5efb161] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:38.762465 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-965ac17e-8570-4cf2-8d13-f53f81d982fb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:38.762646 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c49431fa-72da-455d-8116-b5b4df2f4646 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:38.762931 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-965ac17e-8570-4cf2-8d13-f53f81d982fb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:38.763115 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c49431fa-72da-455d-8116-b5b4df2f4646 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:38.763802 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-965ac17e-8570-4cf2-8d13-f53f81d982fb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:38.763914 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c49431fa-72da-455d-8116-b5b4df2f4646 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:38.764225 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-965ac17e-8570-4cf2-8d13-f53f81d982fb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:38.764334 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c49431fa-72da-455d-8116-b5b4df2f4646 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:38.778754 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-965ac17e-8570-4cf2-8d13-f53f81d982fb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] HTTP exception thrown: Instance 174ae5e4-f21b-4141-88bf-98e7d5efb161 could not be found. Oct 28 08:43:38.779336 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-965ac17e-8570-4cf2-8d13-f53f81d982fb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Returning 404 to user: Instance 174ae5e4-f21b-4141-88bf-98e7d5efb161 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:43:38.780149 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-965ac17e-8570-4cf2-8d13-f53f81d982fb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161" status: 404 len: 111 microversion: 2.1 time: 0.028101 Oct 28 08:43:38.780675 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 350/693] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:38 2021] GET /compute/v2.1/servers/174ae5e4-f21b-4141-88bf-98e7d5efb161 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 08:43:38.788393 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-764613b6-bf94-4ab0-9119-a007f9f4113d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:38.788876 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-764613b6-bf94-4ab0-9119-a007f9f4113d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 047748f3-80f4-4fd5-a32a-18bf0a4a6e32] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:38.794580 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-764613b6-bf94-4ab0-9119-a007f9f4113d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:38.795022 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-764613b6-bf94-4ab0-9119-a007f9f4113d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:38.795779 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-764613b6-bf94-4ab0-9119-a007f9f4113d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:38.796204 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-764613b6-bf94-4ab0-9119-a007f9f4113d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:38.820596 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-764613b6-bf94-4ab0-9119-a007f9f4113d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 047748f3-80f4-4fd5-a32a-18bf0a4a6e32] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:43:38.834531 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c49431fa-72da-455d-8116-b5b4df2f4646 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.084660 Oct 28 08:43:38.835565 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 344/694] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:38 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:38.840538 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5311258d-e94f-4d3e-ae90-dda49b497dab tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:38.841533 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5311258d-e94f-4d3e-ae90-dda49b497dab tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:38.849873 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5311258d-e94f-4d3e-ae90-dda49b497dab tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:38.850321 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5311258d-e94f-4d3e-ae90-dda49b497dab tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:38.851210 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5311258d-e94f-4d3e-ae90-dda49b497dab tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:38.851643 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5311258d-e94f-4d3e-ae90-dda49b497dab tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:38.926420 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-764613b6-bf94-4ab0-9119-a007f9f4113d tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "DELETE /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32" status: 204 len: 0 microversion: 2.1 time: 0.140182 Oct 28 08:43:38.927302 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 351/695] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Oct 28 08:43:38 2021] DELETE /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 08:43:38.929839 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5311258d-e94f-4d3e-ae90-dda49b497dab tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.092884 Oct 28 08:43:38.931008 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 345/696] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:38 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:38.940606 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f277131e-3754-4ad9-8d33-180c10005774 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:38.941306 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f277131e-3754-4ad9-8d33-180c10005774 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 047748f3-80f4-4fd5-a32a-18bf0a4a6e32] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:38.947126 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f277131e-3754-4ad9-8d33-180c10005774 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:38.947584 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f277131e-3754-4ad9-8d33-180c10005774 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:38.948495 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f277131e-3754-4ad9-8d33-180c10005774 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:38.949218 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f277131e-3754-4ad9-8d33-180c10005774 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:38.993514 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b39895c1-716e-49ab-a171-22fd727b5aad tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:38.994322 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b39895c1-716e-49ab-a171-22fd727b5aad tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:39.001933 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b39895c1-716e-49ab-a171-22fd727b5aad tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:39.002374 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b39895c1-716e-49ab-a171-22fd727b5aad tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:39.003175 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b39895c1-716e-49ab-a171-22fd727b5aad tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:39.003669 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b39895c1-716e-49ab-a171-22fd727b5aad tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:39.112616 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-f277131e-3754-4ad9-8d33-180c10005774 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:39.119967 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f277131e-3754-4ad9-8d33-180c10005774 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32" status: 200 len: 1513 microversion: 2.1 time: 0.184894 Oct 28 08:43:39.120681 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 352/697] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:38 2021] GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32 => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:39.159951 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-b39895c1-716e-49ab-a171-22fd727b5aad tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:39.167737 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b39895c1-716e-49ab-a171-22fd727b5aad tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1556 microversion: 2.1 time: 0.178251 Oct 28 08:43:39.168296 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 346/698] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:38 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1556 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:43:39.847314 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e0e5cd18-238f-427b-9bad-c3800f7c6464 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:39.848274 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e0e5cd18-238f-427b-9bad-c3800f7c6464 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:39.854574 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0e5cd18-238f-427b-9bad-c3800f7c6464 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:39.855005 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0e5cd18-238f-427b-9bad-c3800f7c6464 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:39.855771 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0e5cd18-238f-427b-9bad-c3800f7c6464 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:39.856199 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0e5cd18-238f-427b-9bad-c3800f7c6464 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:39.941419 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-09d19604-8f13-4c76-ba71-dfb5c93e047f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:39.942332 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-09d19604-8f13-4c76-ba71-dfb5c93e047f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:39.948938 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-09d19604-8f13-4c76-ba71-dfb5c93e047f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:39.949383 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-09d19604-8f13-4c76-ba71-dfb5c93e047f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:39.950163 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-09d19604-8f13-4c76-ba71-dfb5c93e047f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:39.950616 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-09d19604-8f13-4c76-ba71-dfb5c93e047f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:39.987644 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e0e5cd18-238f-427b-9bad-c3800f7c6464 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.144898 Oct 28 08:43:39.988290 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 353/699] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:39 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:40.019115 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-09d19604-8f13-4c76-ba71-dfb5c93e047f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.081403 Oct 28 08:43:40.019751 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 347/700] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:39 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:43:40.137331 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-847f5294-883c-4fa4-bb03-4b00ffe49144 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:40.138022 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-847f5294-883c-4fa4-bb03-4b00ffe49144 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 047748f3-80f4-4fd5-a32a-18bf0a4a6e32] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:40.145442 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-847f5294-883c-4fa4-bb03-4b00ffe49144 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:40.145885 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-847f5294-883c-4fa4-bb03-4b00ffe49144 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:40.146676 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-847f5294-883c-4fa4-bb03-4b00ffe49144 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:40.147135 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-847f5294-883c-4fa4-bb03-4b00ffe49144 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:40.185754 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f7a31b88-cac2-4bc6-84e6-bbbdbf3e71e0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:40.186449 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f7a31b88-cac2-4bc6-84e6-bbbdbf3e71e0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:40.194816 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7a31b88-cac2-4bc6-84e6-bbbdbf3e71e0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:40.195260 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7a31b88-cac2-4bc6-84e6-bbbdbf3e71e0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:40.196037 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7a31b88-cac2-4bc6-84e6-bbbdbf3e71e0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:40.196475 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7a31b88-cac2-4bc6-84e6-bbbdbf3e71e0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:40.304617 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-847f5294-883c-4fa4-bb03-4b00ffe49144 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:40.311872 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-847f5294-883c-4fa4-bb03-4b00ffe49144 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32" status: 200 len: 1513 microversion: 2.1 time: 0.178496 Oct 28 08:43:40.313951 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 354/701] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:40 2021] GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32 => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:40.354223 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-f7a31b88-cac2-4bc6-84e6-bbbdbf3e71e0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:40.362841 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f7a31b88-cac2-4bc6-84e6-bbbdbf3e71e0 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1556 microversion: 2.1 time: 0.181139 Oct 28 08:43:40.363418 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 348/702] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:40 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1556 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:43:40.999456 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5ae7738f-f513-4a46-af8c-f67b8ec53675 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:41.000720 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5ae7738f-f513-4a46-af8c-f67b8ec53675 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:41.007196 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ae7738f-f513-4a46-af8c-f67b8ec53675 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:41.007638 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ae7738f-f513-4a46-af8c-f67b8ec53675 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:41.008404 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ae7738f-f513-4a46-af8c-f67b8ec53675 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:41.008837 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ae7738f-f513-4a46-af8c-f67b8ec53675 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:41.030739 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d2e149cc-8894-4f33-bd65-6c28638f95ce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:41.032370 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d2e149cc-8894-4f33-bd65-6c28638f95ce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:41.038618 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2e149cc-8894-4f33-bd65-6c28638f95ce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:41.039070 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2e149cc-8894-4f33-bd65-6c28638f95ce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:41.039834 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2e149cc-8894-4f33-bd65-6c28638f95ce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:41.040266 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2e149cc-8894-4f33-bd65-6c28638f95ce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:41.111732 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d2e149cc-8894-4f33-bd65-6c28638f95ce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.084544 Oct 28 08:43:41.112377 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 349/703] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:41 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:43:41.114859 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5ae7738f-f513-4a46-af8c-f67b8ec53675 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.118808 Oct 28 08:43:41.115693 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 355/704] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:40 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:41.330228 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8ffe7554-f474-43fd-9a01-1176b5246ebd tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:41.330956 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8ffe7554-f474-43fd-9a01-1176b5246ebd tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 047748f3-80f4-4fd5-a32a-18bf0a4a6e32] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:41.337756 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ffe7554-f474-43fd-9a01-1176b5246ebd tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:41.338203 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ffe7554-f474-43fd-9a01-1176b5246ebd tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:41.338990 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ffe7554-f474-43fd-9a01-1176b5246ebd tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:41.339458 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ffe7554-f474-43fd-9a01-1176b5246ebd tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:41.380087 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-13091019-95f1-4075-9644-058a7a6da279 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:41.380785 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-13091019-95f1-4075-9644-058a7a6da279 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:41.387655 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13091019-95f1-4075-9644-058a7a6da279 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:41.388099 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13091019-95f1-4075-9644-058a7a6da279 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:41.388863 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13091019-95f1-4075-9644-058a7a6da279 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:41.389286 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13091019-95f1-4075-9644-058a7a6da279 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:41.502659 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-8ffe7554-f474-43fd-9a01-1176b5246ebd tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:41.510111 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8ffe7554-f474-43fd-9a01-1176b5246ebd tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32" status: 200 len: 1513 microversion: 2.1 time: 0.184479 Oct 28 08:43:41.510727 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 350/705] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:41 2021] GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32 => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:43:41.539380 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-13091019-95f1-4075-9644-058a7a6da279 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:41.547231 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-13091019-95f1-4075-9644-058a7a6da279 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1556 microversion: 2.1 time: 0.171055 Oct 28 08:43:41.547789 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 356/706] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:41 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:43:42.129540 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fbd97b11-d790-4adc-be00-93b59f2f1127 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:42.130352 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d5572f74-1240-46c1-b5a1-ee99f2f0386f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:42.130849 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fbd97b11-d790-4adc-be00-93b59f2f1127 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:42.138367 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d5572f74-1240-46c1-b5a1-ee99f2f0386f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:42.146119 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fbd97b11-d790-4adc-be00-93b59f2f1127 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:42.148027 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fbd97b11-d790-4adc-be00-93b59f2f1127 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:42.148581 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5572f74-1240-46c1-b5a1-ee99f2f0386f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:42.149048 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fbd97b11-d790-4adc-be00-93b59f2f1127 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:42.149364 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5572f74-1240-46c1-b5a1-ee99f2f0386f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:42.149704 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fbd97b11-d790-4adc-be00-93b59f2f1127 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:42.150523 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5572f74-1240-46c1-b5a1-ee99f2f0386f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:42.151103 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5572f74-1240-46c1-b5a1-ee99f2f0386f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:42.229287 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fbd97b11-d790-4adc-be00-93b59f2f1127 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.104709 Oct 28 08:43:42.230202 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 357/707] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:42 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:42.236457 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-abc13d1b-c830-470a-aefb-8c4b7bc33316 req-d0a0dcdf-4bf5-4abb-993e-12a4f2f79b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "047748f3-80f4-4fd5-a32a-18bf0a4a6e32", "name": "network-vif-deleted", "tag": "24e2f8e1-d18e-4de5-8def-21249af05cd2"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:42.238026 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:43:42.238026 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:43:42.246744 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d5572f74-1240-46c1-b5a1-ee99f2f0386f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.123827 Oct 28 08:43:42.247131 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-abc13d1b-c830-470a-aefb-8c4b7bc33316 req-d0a0dcdf-4bf5-4abb-993e-12a4f2f79b99 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:42.247766 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-abc13d1b-c830-470a-aefb-8c4b7bc33316 req-d0a0dcdf-4bf5-4abb-993e-12a4f2f79b99 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:42.247995 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 351/708] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:42 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:42.262551 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-abc13d1b-c830-470a-aefb-8c4b7bc33316 req-d0a0dcdf-4bf5-4abb-993e-12a4f2f79b99 service nova] Creating event network-vif-deleted:24e2f8e1-d18e-4de5-8def-21249af05cd2 for instance 047748f3-80f4-4fd5-a32a-18bf0a4a6e32 on hv-cinder-81565 Oct 28 08:43:42.268257 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-abc13d1b-c830-470a-aefb-8c4b7bc33316 req-d0a0dcdf-4bf5-4abb-993e-12a4f2f79b99 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036300 Oct 28 08:43:42.269108 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 358/709] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:43:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:43:42.528288 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d480ff5a-aa9f-4b19-abf6-a6e37000369e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:42.529018 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d480ff5a-aa9f-4b19-abf6-a6e37000369e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 047748f3-80f4-4fd5-a32a-18bf0a4a6e32] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:42.536599 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d480ff5a-aa9f-4b19-abf6-a6e37000369e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:42.537040 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d480ff5a-aa9f-4b19-abf6-a6e37000369e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:42.537804 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d480ff5a-aa9f-4b19-abf6-a6e37000369e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:42.538233 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d480ff5a-aa9f-4b19-abf6-a6e37000369e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:42.565121 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-386d6193-4b04-4400-a783-16f94f9cb18f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:42.565811 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-386d6193-4b04-4400-a783-16f94f9cb18f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:42.569566 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d480ff5a-aa9f-4b19-abf6-a6e37000369e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:42.570027 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d480ff5a-aa9f-4b19-abf6-a6e37000369e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:42.570457 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-d480ff5a-aa9f-4b19-abf6-a6e37000369e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lazy-loading 'fault' on Instance uuid 047748f3-80f4-4fd5-a32a-18bf0a4a6e32 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:43:42.571671 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-386d6193-4b04-4400-a783-16f94f9cb18f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:42.572118 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-386d6193-4b04-4400-a783-16f94f9cb18f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:42.572930 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-386d6193-4b04-4400-a783-16f94f9cb18f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:42.573359 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-386d6193-4b04-4400-a783-16f94f9cb18f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:42.617149 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-d480ff5a-aa9f-4b19-abf6-a6e37000369e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:42.624931 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d480ff5a-aa9f-4b19-abf6-a6e37000369e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32" status: 200 len: 1307 microversion: 2.1 time: 0.100483 Oct 28 08:43:42.625531 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 352/710] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:42 2021] GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32 => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:42.705667 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-386d6193-4b04-4400-a783-16f94f9cb18f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:42.717615 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-386d6193-4b04-4400-a783-16f94f9cb18f tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1556 microversion: 2.1 time: 0.156564 Oct 28 08:43:42.719283 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 359/711] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:42 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:43:43.241394 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-233bb62b-bd26-40f3-85f5-625a6f603e82 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:43.242309 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-233bb62b-bd26-40f3-85f5-625a6f603e82 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:43.248525 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-233bb62b-bd26-40f3-85f5-625a6f603e82 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:43.249006 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-233bb62b-bd26-40f3-85f5-625a6f603e82 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:43.249772 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-233bb62b-bd26-40f3-85f5-625a6f603e82 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:43.250817 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-233bb62b-bd26-40f3-85f5-625a6f603e82 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:43.259250 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d1b0f086-7aa7-4aff-afac-7aa14e17329c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:43.260185 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d1b0f086-7aa7-4aff-afac-7aa14e17329c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:43.267483 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d1b0f086-7aa7-4aff-afac-7aa14e17329c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:43.267853 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d1b0f086-7aa7-4aff-afac-7aa14e17329c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:43.268643 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d1b0f086-7aa7-4aff-afac-7aa14e17329c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:43.269067 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d1b0f086-7aa7-4aff-afac-7aa14e17329c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:43.327806 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-233bb62b-bd26-40f3-85f5-625a6f603e82 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.089956 Oct 28 08:43:43.329453 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 353/712] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:43 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:43.342044 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d1b0f086-7aa7-4aff-afac-7aa14e17329c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.086223 Oct 28 08:43:43.342704 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 360/713] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:43 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:43:43.642134 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b231cae4-feb2-4023-9646-6ef86ff03753 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:43.642845 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b231cae4-feb2-4023-9646-6ef86ff03753 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 047748f3-80f4-4fd5-a32a-18bf0a4a6e32] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:43.649697 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b231cae4-feb2-4023-9646-6ef86ff03753 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:43.650135 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b231cae4-feb2-4023-9646-6ef86ff03753 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:43.650921 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b231cae4-feb2-4023-9646-6ef86ff03753 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:43.651352 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b231cae4-feb2-4023-9646-6ef86ff03753 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:43.664884 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-b231cae4-feb2-4023-9646-6ef86ff03753 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] HTTP exception thrown: Instance 047748f3-80f4-4fd5-a32a-18bf0a4a6e32 could not be found. Oct 28 08:43:43.665459 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b231cae4-feb2-4023-9646-6ef86ff03753 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Returning 404 to user: Instance 047748f3-80f4-4fd5-a32a-18bf0a4a6e32 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:43:43.666266 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b231cae4-feb2-4023-9646-6ef86ff03753 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32" status: 404 len: 111 microversion: 2.1 time: 0.028181 Oct 28 08:43:43.666885 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 354/714] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:43 2021] GET /compute/v2.1/servers/047748f3-80f4-4fd5-a32a-18bf0a4a6e32 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:43:43.744373 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-13208b98-556f-4056-82e1-dbaba22d1264 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:43.745072 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-13208b98-556f-4056-82e1-dbaba22d1264 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:43.752542 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13208b98-556f-4056-82e1-dbaba22d1264 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:43.752986 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13208b98-556f-4056-82e1-dbaba22d1264 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:43.753753 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13208b98-556f-4056-82e1-dbaba22d1264 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:43.754182 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13208b98-556f-4056-82e1-dbaba22d1264 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:43.877202 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-13208b98-556f-4056-82e1-dbaba22d1264 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:43.885344 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-13208b98-556f-4056-82e1-dbaba22d1264 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1562 microversion: 2.1 time: 0.145356 Oct 28 08:43:43.885904 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 361/715] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:43 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1562 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:43.952087 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7e9d6fe4-1f49-471b-9812-23b3540e4d7b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:43.952579 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7e9d6fe4-1f49-471b-9812-23b3540e4d7b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:43.959387 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e9d6fe4-1f49-471b-9812-23b3540e4d7b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:43.959835 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e9d6fe4-1f49-471b-9812-23b3540e4d7b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:43.960601 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e9d6fe4-1f49-471b-9812-23b3540e4d7b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:43.961032 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e9d6fe4-1f49-471b-9812-23b3540e4d7b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:44.042299 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-7e9d6fe4-1f49-471b-9812-23b3540e4d7b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lazy-loading 'services' on Instance uuid a432ca47-c48c-4e08-8b76-0025d9ef360b {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:43:44.126623 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7e9d6fe4-1f49-471b-9812-23b3540e4d7b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "DELETE /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b/os-volume_attachments/f0213758-2f10-44cc-abde-eb942d226cf8" status: 202 len: 0 microversion: 2.1 time: 0.178199 Oct 28 08:43:44.127203 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 355/716] 10.222.0.76 () {58 vars in 1415 bytes} [Thu Oct 28 08:43:43 2021] DELETE /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b/os-volume_attachments/f0213758-2f10-44cc-abde-eb942d226cf8 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:44.135283 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d1c17d60-ce57-49de-9cdf-2003044120bb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:44.136187 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d1c17d60-ce57-49de-9cdf-2003044120bb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:44.143044 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d1c17d60-ce57-49de-9cdf-2003044120bb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:44.143765 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d1c17d60-ce57-49de-9cdf-2003044120bb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:44.144502 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d1c17d60-ce57-49de-9cdf-2003044120bb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:44.144930 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d1c17d60-ce57-49de-9cdf-2003044120bb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:44.176359 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d1c17d60-ce57-49de-9cdf-2003044120bb tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044701 Oct 28 08:43:44.176917 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 362/717] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Oct 28 08:43:44 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:43:44.340737 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3494b375-b814-43ce-a08c-4dda4b4e1631 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:44.341828 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3494b375-b814-43ce-a08c-4dda4b4e1631 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:44.349246 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3494b375-b814-43ce-a08c-4dda4b4e1631 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:44.349695 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3494b375-b814-43ce-a08c-4dda4b4e1631 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:44.350474 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3494b375-b814-43ce-a08c-4dda4b4e1631 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:44.350938 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3494b375-b814-43ce-a08c-4dda4b4e1631 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:44.352961 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6ede347e-9a0d-4d30-93f2-bc6ea83c4e8e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:44.353873 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6ede347e-9a0d-4d30-93f2-bc6ea83c4e8e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:44.360260 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ede347e-9a0d-4d30-93f2-bc6ea83c4e8e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:44.360732 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ede347e-9a0d-4d30-93f2-bc6ea83c4e8e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:44.361497 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ede347e-9a0d-4d30-93f2-bc6ea83c4e8e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:44.361923 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ede347e-9a0d-4d30-93f2-bc6ea83c4e8e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:44.493959 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3494b375-b814-43ce-a08c-4dda4b4e1631 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.156874 Oct 28 08:43:44.494545 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 356/718] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:44 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:44.517647 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6ede347e-9a0d-4d30-93f2-bc6ea83c4e8e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.168052 Oct 28 08:43:44.518280 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 363/719] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:44 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:43:44.799493 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-56aba17c-c9bb-4e49-a153-cf7e03e7fe86 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:44.800214 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-56aba17c-c9bb-4e49-a153-cf7e03e7fe86 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:44.807915 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56aba17c-c9bb-4e49-a153-cf7e03e7fe86 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:44.808394 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56aba17c-c9bb-4e49-a153-cf7e03e7fe86 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:44.809235 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56aba17c-c9bb-4e49-a153-cf7e03e7fe86 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:44.809662 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56aba17c-c9bb-4e49-a153-cf7e03e7fe86 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:44.836484 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-56aba17c-c9bb-4e49-a153-cf7e03e7fe86 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:43:44.912982 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-56aba17c-c9bb-4e49-a153-cf7e03e7fe86 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "DELETE /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 204 len: 0 microversion: 2.1 time: 0.118288 Oct 28 08:43:44.913737 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 357/720] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Oct 28 08:43:44 2021] DELETE /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:43:44.922277 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-94a5803d-865c-4fc0-bb24-ae1171f96adb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:44.923296 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-94a5803d-865c-4fc0-bb24-ae1171f96adb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:44.930557 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94a5803d-865c-4fc0-bb24-ae1171f96adb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:44.931000 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94a5803d-865c-4fc0-bb24-ae1171f96adb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:44.931776 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94a5803d-865c-4fc0-bb24-ae1171f96adb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:44.932220 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94a5803d-865c-4fc0-bb24-ae1171f96adb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:45.063130 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-94a5803d-865c-4fc0-bb24-ae1171f96adb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:45.071173 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-94a5803d-865c-4fc0-bb24-ae1171f96adb tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1514 microversion: 2.1 time: 0.153092 Oct 28 08:43:45.071735 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 364/721] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:44 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:45.189035 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-61066886-2bb0-4b09-9871-cd8b84f3add4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:45.190142 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-61066886-2bb0-4b09-9871-cd8b84f3add4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:45.196314 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61066886-2bb0-4b09-9871-cd8b84f3add4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:45.196758 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61066886-2bb0-4b09-9871-cd8b84f3add4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:45.197564 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61066886-2bb0-4b09-9871-cd8b84f3add4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:45.197983 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61066886-2bb0-4b09-9871-cd8b84f3add4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:45.228444 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-61066886-2bb0-4b09-9871-cd8b84f3add4 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044460 Oct 28 08:43:45.229003 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 358/722] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Oct 28 08:43:45 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:43:45.506543 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ffc44b7f-d4ea-41e9-bdf4-9c1e7b47734d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:45.507824 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ffc44b7f-d4ea-41e9-bdf4-9c1e7b47734d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:45.514123 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ffc44b7f-d4ea-41e9-bdf4-9c1e7b47734d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:45.514710 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ffc44b7f-d4ea-41e9-bdf4-9c1e7b47734d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:45.515550 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ffc44b7f-d4ea-41e9-bdf4-9c1e7b47734d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:45.516861 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ffc44b7f-d4ea-41e9-bdf4-9c1e7b47734d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:45.529828 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4f00471d-58f3-4a6e-a830-1540d2e1a8cb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:45.530908 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4f00471d-58f3-4a6e-a830-1540d2e1a8cb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:45.538981 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f00471d-58f3-4a6e-a830-1540d2e1a8cb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:45.539480 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f00471d-58f3-4a6e-a830-1540d2e1a8cb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:45.540206 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f00471d-58f3-4a6e-a830-1540d2e1a8cb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:45.540636 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f00471d-58f3-4a6e-a830-1540d2e1a8cb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:45.599599 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ffc44b7f-d4ea-41e9-bdf4-9c1e7b47734d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.096437 Oct 28 08:43:45.600208 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 365/723] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:45 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:45.624310 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4f00471d-58f3-4a6e-a830-1540d2e1a8cb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.098107 Oct 28 08:43:45.625897 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 359/724] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:45 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:43:46.089209 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-36597d8c-f943-408e-b4a6-4ec794d0ecf9 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:46.089897 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-36597d8c-f943-408e-b4a6-4ec794d0ecf9 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:46.097878 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36597d8c-f943-408e-b4a6-4ec794d0ecf9 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:46.098323 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36597d8c-f943-408e-b4a6-4ec794d0ecf9 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:46.099164 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36597d8c-f943-408e-b4a6-4ec794d0ecf9 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:46.099541 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36597d8c-f943-408e-b4a6-4ec794d0ecf9 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:46.224573 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-36597d8c-f943-408e-b4a6-4ec794d0ecf9 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:46.232118 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-36597d8c-f943-408e-b4a6-4ec794d0ecf9 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1514 microversion: 2.1 time: 0.146878 Oct 28 08:43:46.232690 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 366/725] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:46 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:46.611901 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-901d2967-e754-4f4e-87bd-d5b023bd4642 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:46.612902 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-901d2967-e754-4f4e-87bd-d5b023bd4642 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:46.619719 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-901d2967-e754-4f4e-87bd-d5b023bd4642 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:46.620163 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-901d2967-e754-4f4e-87bd-d5b023bd4642 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:46.620921 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-901d2967-e754-4f4e-87bd-d5b023bd4642 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:46.621352 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-901d2967-e754-4f4e-87bd-d5b023bd4642 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:46.636576 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-44ace195-db7b-484d-8a01-79d306dd5363 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:46.637510 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-44ace195-db7b-484d-8a01-79d306dd5363 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:46.644189 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44ace195-db7b-484d-8a01-79d306dd5363 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:46.644637 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44ace195-db7b-484d-8a01-79d306dd5363 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:46.645406 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44ace195-db7b-484d-8a01-79d306dd5363 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:46.645837 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44ace195-db7b-484d-8a01-79d306dd5363 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:50.255768 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-44ace195-db7b-484d-8a01-79d306dd5363 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 3.622592 Oct 28 08:43:50.256450 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 367/726] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:46 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 3624 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:43:50.261301 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4a1346bc-6687-4712-a319-497a4c2d7a61 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:50.261990 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4a1346bc-6687-4712-a319-497a4c2d7a61 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:50.268841 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a1346bc-6687-4712-a319-497a4c2d7a61 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:50.269283 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a1346bc-6687-4712-a319-497a4c2d7a61 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:50.270060 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a1346bc-6687-4712-a319-497a4c2d7a61 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:50.270515 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a1346bc-6687-4712-a319-497a4c2d7a61 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:50.315174 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-901d2967-e754-4f4e-87bd-d5b023bd4642 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 3.707139 Oct 28 08:43:50.319038 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 360/727] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:46 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 3709 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:50.397619 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-4a1346bc-6687-4712-a319-497a4c2d7a61 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:50.404948 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4a1346bc-6687-4712-a319-497a4c2d7a61 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1514 microversion: 2.1 time: 0.147533 Oct 28 08:43:50.405513 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 368/728] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:50 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:51.269013 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d0eae13a-1d10-4ae2-b565-c1e0508b49eb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:51.270012 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d0eae13a-1d10-4ae2-b565-c1e0508b49eb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:51.279399 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0eae13a-1d10-4ae2-b565-c1e0508b49eb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:51.279847 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0eae13a-1d10-4ae2-b565-c1e0508b49eb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:51.280616 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0eae13a-1d10-4ae2-b565-c1e0508b49eb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:51.281104 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0eae13a-1d10-4ae2-b565-c1e0508b49eb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:51.326785 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-528f9575-49c9-4919-b4b7-3d440df621fb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:51.327731 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-528f9575-49c9-4919-b4b7-3d440df621fb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:51.335354 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-528f9575-49c9-4919-b4b7-3d440df621fb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:51.335799 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-528f9575-49c9-4919-b4b7-3d440df621fb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:51.336603 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-528f9575-49c9-4919-b4b7-3d440df621fb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:51.337038 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-528f9575-49c9-4919-b4b7-3d440df621fb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:51.369387 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d0eae13a-1d10-4ae2-b565-c1e0508b49eb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.105192 Oct 28 08:43:51.370109 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 361/729] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:51 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:51.423218 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b79cd1eb-bac1-45ad-b707-0d7eab94c45e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:51.423938 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b79cd1eb-bac1-45ad-b707-0d7eab94c45e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:51.431084 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b79cd1eb-bac1-45ad-b707-0d7eab94c45e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:51.431523 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b79cd1eb-bac1-45ad-b707-0d7eab94c45e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:51.432466 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b79cd1eb-bac1-45ad-b707-0d7eab94c45e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:51.432896 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b79cd1eb-bac1-45ad-b707-0d7eab94c45e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:51.436861 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-528f9575-49c9-4919-b4b7-3d440df621fb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.113706 Oct 28 08:43:51.441825 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 369/730] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:51 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:51.587623 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-b79cd1eb-bac1-45ad-b707-0d7eab94c45e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:51.596138 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b79cd1eb-bac1-45ad-b707-0d7eab94c45e tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1514 microversion: 2.1 time: 0.176731 Oct 28 08:43:51.596917 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 362/731] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:51 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:43:52.381932 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f970eabb-0bdd-4560-b798-98fb7a869a12 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:52.383052 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f970eabb-0bdd-4560-b798-98fb7a869a12 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:52.389793 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f970eabb-0bdd-4560-b798-98fb7a869a12 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:52.390956 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f970eabb-0bdd-4560-b798-98fb7a869a12 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:52.392315 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f970eabb-0bdd-4560-b798-98fb7a869a12 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:52.392769 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f970eabb-0bdd-4560-b798-98fb7a869a12 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:52.449093 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-395240f9-d6dc-470d-9c81-3cafd513e0f6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:52.450045 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-395240f9-d6dc-470d-9c81-3cafd513e0f6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:52.458033 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-395240f9-d6dc-470d-9c81-3cafd513e0f6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:52.458468 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-395240f9-d6dc-470d-9c81-3cafd513e0f6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:52.459263 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-395240f9-d6dc-470d-9c81-3cafd513e0f6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:52.459692 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-395240f9-d6dc-470d-9c81-3cafd513e0f6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:52.507548 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f970eabb-0bdd-4560-b798-98fb7a869a12 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.129509 Oct 28 08:43:52.509593 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 370/732] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:52 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:52.513820 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-7f2387c6-06f9-4762-aea0-357408a41410 req-69670b42-0257-4afc-a4c7-822deb5d6056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3127fb3d-04bf-4ef2-b534-cd6fd65f614f", "name": "network-vif-deleted", "tag": "64609431-9691-46a8-a89b-e479eb357768"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:52.515895 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:43:52.515895 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:43:52.523523 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7f2387c6-06f9-4762-aea0-357408a41410 req-69670b42-0257-4afc-a4c7-822deb5d6056 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:52.523936 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7f2387c6-06f9-4762-aea0-357408a41410 req-69670b42-0257-4afc-a4c7-822deb5d6056 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:52.535544 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-7f2387c6-06f9-4762-aea0-357408a41410 req-69670b42-0257-4afc-a4c7-822deb5d6056 service nova] Creating event network-vif-deleted:64609431-9691-46a8-a89b-e479eb357768 for instance 3127fb3d-04bf-4ef2-b534-cd6fd65f614f on hv-cinder-81565 Oct 28 08:43:52.540208 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-7f2387c6-06f9-4762-aea0-357408a41410 req-69670b42-0257-4afc-a4c7-822deb5d6056 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030681 Oct 28 08:43:52.540801 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 371/733] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:43:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:43:52.553324 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-395240f9-d6dc-470d-9c81-3cafd513e0f6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.107600 Oct 28 08:43:52.557281 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 363/734] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:52 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:52.614183 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-07d97f7c-4868-4b04-bfd6-327de24358ba tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:52.614904 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-07d97f7c-4868-4b04-bfd6-327de24358ba tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:52.621001 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07d97f7c-4868-4b04-bfd6-327de24358ba tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:52.621444 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07d97f7c-4868-4b04-bfd6-327de24358ba tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:52.622209 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07d97f7c-4868-4b04-bfd6-327de24358ba tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:52.622672 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07d97f7c-4868-4b04-bfd6-327de24358ba tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:52.653744 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07d97f7c-4868-4b04-bfd6-327de24358ba tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:52.654099 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07d97f7c-4868-4b04-bfd6-327de24358ba tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:52.654570 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-07d97f7c-4868-4b04-bfd6-327de24358ba tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lazy-loading 'fault' on Instance uuid 3127fb3d-04bf-4ef2-b534-cd6fd65f614f {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:43:52.694812 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-07d97f7c-4868-4b04-bfd6-327de24358ba tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a3f84e4d9b4c77aab465f1e4df493d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831003e70cf4a62afb1393fbea6654e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:52.702037 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-07d97f7c-4868-4b04-bfd6-327de24358ba tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 200 len: 1308 microversion: 2.1 time: 0.092292 Oct 28 08:43:52.702632 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 372/735] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:52 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:53.519837 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aefa79a5-229b-43a4-99f4-66193b4078fc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:53.520783 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-aefa79a5-229b-43a4-99f4-66193b4078fc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:53.527552 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aefa79a5-229b-43a4-99f4-66193b4078fc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:53.527999 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aefa79a5-229b-43a4-99f4-66193b4078fc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:53.528777 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aefa79a5-229b-43a4-99f4-66193b4078fc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:53.529209 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aefa79a5-229b-43a4-99f4-66193b4078fc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:53.565345 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5fb0f707-4a4b-4710-b3ba-8f3b37408808 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:53.566248 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5fb0f707-4a4b-4710-b3ba-8f3b37408808 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:53.572478 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fb0f707-4a4b-4710-b3ba-8f3b37408808 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:53.572918 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fb0f707-4a4b-4710-b3ba-8f3b37408808 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:53.573679 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fb0f707-4a4b-4710-b3ba-8f3b37408808 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:53.574117 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fb0f707-4a4b-4710-b3ba-8f3b37408808 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:53.596322 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-aefa79a5-229b-43a4-99f4-66193b4078fc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.080839 Oct 28 08:43:53.600179 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 364/736] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:53 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:53.641373 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5fb0f707-4a4b-4710-b3ba-8f3b37408808 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.079346 Oct 28 08:43:53.641996 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 373/737] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:53 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:53.720728 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-18f2f3e1-9cf6-4e43-8632-3b4369104ad2 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:53.721674 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-18f2f3e1-9cf6-4e43-8632-3b4369104ad2 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] [instance: 3127fb3d-04bf-4ef2-b534-cd6fd65f614f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:53.728464 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18f2f3e1-9cf6-4e43-8632-3b4369104ad2 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:53.728905 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18f2f3e1-9cf6-4e43-8632-3b4369104ad2 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:53.729664 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18f2f3e1-9cf6-4e43-8632-3b4369104ad2 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:53.730092 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18f2f3e1-9cf6-4e43-8632-3b4369104ad2 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:53.743721 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-18f2f3e1-9cf6-4e43-8632-3b4369104ad2 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] HTTP exception thrown: Instance 3127fb3d-04bf-4ef2-b534-cd6fd65f614f could not be found. Oct 28 08:43:53.744299 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-18f2f3e1-9cf6-4e43-8632-3b4369104ad2 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] Returning 404 to user: Instance 3127fb3d-04bf-4ef2-b534-cd6fd65f614f could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:43:53.745107 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-18f2f3e1-9cf6-4e43-8632-3b4369104ad2 tempest-AttachVolumeNegativeTest-1502508043 tempest-AttachVolumeNegativeTest-1502508043-project] 10.222.0.76 "GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f" status: 404 len: 111 microversion: 2.1 time: 0.028708 Oct 28 08:43:53.745629 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 365/738] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:53 2021] GET /compute/v2.1/servers/3127fb3d-04bf-4ef2-b534-cd6fd65f614f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:43:54.608285 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9a663568-0c03-49b6-a197-cddbd8e14f96 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:54.609388 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9a663568-0c03-49b6-a197-cddbd8e14f96 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:54.617147 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a663568-0c03-49b6-a197-cddbd8e14f96 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:54.617585 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a663568-0c03-49b6-a197-cddbd8e14f96 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:54.619376 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a663568-0c03-49b6-a197-cddbd8e14f96 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:54.619816 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a663568-0c03-49b6-a197-cddbd8e14f96 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:54.653836 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ff7973cf-eca0-462c-991d-7d3622264d41 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:54.654916 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ff7973cf-eca0-462c-991d-7d3622264d41 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:54.661718 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff7973cf-eca0-462c-991d-7d3622264d41 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:54.662185 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff7973cf-eca0-462c-991d-7d3622264d41 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:54.663142 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff7973cf-eca0-462c-991d-7d3622264d41 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:54.663582 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff7973cf-eca0-462c-991d-7d3622264d41 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:54.696893 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9a663568-0c03-49b6-a197-cddbd8e14f96 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.092447 Oct 28 08:43:54.697645 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 374/739] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:54 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:54.728417 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ff7973cf-eca0-462c-991d-7d3622264d41 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.078806 Oct 28 08:43:54.732472 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 366/740] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:54 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:54.880320 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-88cfd93f-014e-4370-84e1-d1639d5e898a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:54.881191 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-88cfd93f-014e-4370-84e1-d1639d5e898a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:54.889244 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88cfd93f-014e-4370-84e1-d1639d5e898a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:54.889786 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88cfd93f-014e-4370-84e1-d1639d5e898a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:54.890699 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88cfd93f-014e-4370-84e1-d1639d5e898a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:54.891134 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88cfd93f-014e-4370-84e1-d1639d5e898a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:54.917257 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-88cfd93f-014e-4370-84e1-d1639d5e898a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:43:54.997188 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-88cfd93f-014e-4370-84e1-d1639d5e898a tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "DELETE /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 204 len: 0 microversion: 2.1 time: 0.122411 Oct 28 08:43:54.997790 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 375/741] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Oct 28 08:43:54 2021] DELETE /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:43:55.006679 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e5f151a2-71eb-4182-855f-e486ea2fa38e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:55.007515 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e5f151a2-71eb-4182-855f-e486ea2fa38e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:55.016156 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5f151a2-71eb-4182-855f-e486ea2fa38e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:55.017107 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5f151a2-71eb-4182-855f-e486ea2fa38e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:55.017952 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5f151a2-71eb-4182-855f-e486ea2fa38e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:55.018458 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5f151a2-71eb-4182-855f-e486ea2fa38e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:55.152428 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-e5f151a2-71eb-4182-855f-e486ea2fa38e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:55.160729 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e5f151a2-71eb-4182-855f-e486ea2fa38e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1507 microversion: 2.1 time: 0.158469 Oct 28 08:43:55.161491 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 367/742] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:55 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:55.710278 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cff62d34-0105-49f1-9eb4-f5c52f5518b6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:55.711304 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cff62d34-0105-49f1-9eb4-f5c52f5518b6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:55.718387 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cff62d34-0105-49f1-9eb4-f5c52f5518b6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:55.719433 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cff62d34-0105-49f1-9eb4-f5c52f5518b6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:55.720254 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cff62d34-0105-49f1-9eb4-f5c52f5518b6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:55.720690 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cff62d34-0105-49f1-9eb4-f5c52f5518b6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:55.742434 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6dc03030-0eba-42a6-803e-76006c336618 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:55.743435 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6dc03030-0eba-42a6-803e-76006c336618 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:55.750682 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6dc03030-0eba-42a6-803e-76006c336618 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:55.751151 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6dc03030-0eba-42a6-803e-76006c336618 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:55.752125 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6dc03030-0eba-42a6-803e-76006c336618 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:55.752630 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6dc03030-0eba-42a6-803e-76006c336618 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:55.810067 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cff62d34-0105-49f1-9eb4-f5c52f5518b6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.103633 Oct 28 08:43:55.810757 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 376/743] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:55 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:55.851853 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6dc03030-0eba-42a6-803e-76006c336618 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.113485 Oct 28 08:43:55.852532 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 368/744] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:55 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:56.177470 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9ee623a2-4ca4-45b5-8f6a-1aa82a6e689b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:56.178072 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9ee623a2-4ca4-45b5-8f6a-1aa82a6e689b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:56.184883 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ee623a2-4ca4-45b5-8f6a-1aa82a6e689b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:56.185327 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ee623a2-4ca4-45b5-8f6a-1aa82a6e689b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:56.186112 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ee623a2-4ca4-45b5-8f6a-1aa82a6e689b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:56.186569 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ee623a2-4ca4-45b5-8f6a-1aa82a6e689b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:56.311117 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-9ee623a2-4ca4-45b5-8f6a-1aa82a6e689b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:56.318960 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9ee623a2-4ca4-45b5-8f6a-1aa82a6e689b tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1507 microversion: 2.1 time: 0.145548 Oct 28 08:43:56.319518 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 377/745] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:56 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1507 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:56.822283 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f0211835-dc51-4ba0-a622-3b123edba26f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:56.823308 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f0211835-dc51-4ba0-a622-3b123edba26f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:56.830200 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0211835-dc51-4ba0-a622-3b123edba26f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:56.830708 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0211835-dc51-4ba0-a622-3b123edba26f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:56.831473 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0211835-dc51-4ba0-a622-3b123edba26f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:56.831905 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0211835-dc51-4ba0-a622-3b123edba26f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:56.864127 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bd2583f4-83bc-4b3d-b4d8-7fe4998d4e7c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:56.865094 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bd2583f4-83bc-4b3d-b4d8-7fe4998d4e7c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:56.871411 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd2583f4-83bc-4b3d-b4d8-7fe4998d4e7c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:56.871852 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd2583f4-83bc-4b3d-b4d8-7fe4998d4e7c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:56.872615 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd2583f4-83bc-4b3d-b4d8-7fe4998d4e7c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:56.873045 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd2583f4-83bc-4b3d-b4d8-7fe4998d4e7c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:56.895158 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f0211835-dc51-4ba0-a622-3b123edba26f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.076723 Oct 28 08:43:56.898906 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 369/746] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:56 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:56.954986 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bd2583f4-83bc-4b3d-b4d8-7fe4998d4e7c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.094334 Oct 28 08:43:56.955659 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 378/747] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:56 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:57.337032 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f630a6eb-eda7-4067-a21d-aad3923e5063 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:57.337775 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f630a6eb-eda7-4067-a21d-aad3923e5063 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:57.345399 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f630a6eb-eda7-4067-a21d-aad3923e5063 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:57.346272 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f630a6eb-eda7-4067-a21d-aad3923e5063 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:57.347205 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f630a6eb-eda7-4067-a21d-aad3923e5063 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:57.347654 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f630a6eb-eda7-4067-a21d-aad3923e5063 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:57.475927 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-f630a6eb-eda7-4067-a21d-aad3923e5063 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:57.483730 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f630a6eb-eda7-4067-a21d-aad3923e5063 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1507 microversion: 2.1 time: 0.151058 Oct 28 08:43:57.484373 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 370/748] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:57 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:57.785851 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-82d930aa-9fd9-4f23-a2bf-aedcf4067ad5 tempest-VolumesTestJSON-661126910 tempest-VolumesTestJSON-661126910-project] Calling method '.version_select at 0x7fed6f38f040>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:57.832669 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-82d930aa-9fd9-4f23-a2bf-aedcf4067ad5 tempest-VolumesTestJSON-661126910 tempest-VolumesTestJSON-661126910-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/a9368ad3-52b6-40ef-85ac-64020bda0676" status: 200 len: 351 microversion: 2.1 time: 0.050678 Oct 28 08:43:57.833233 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 379/749] 10.222.0.76 () {58 vars in 1244 bytes} [Thu Oct 28 08:43:57 2021] GET /compute/v2.1/os-volumes/a9368ad3-52b6-40ef-85ac-64020bda0676 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:43:57.907716 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5f29ed35-a931-47fb-9096-6146328ea0c4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:57.908649 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5f29ed35-a931-47fb-9096-6146328ea0c4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:57.914864 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f29ed35-a931-47fb-9096-6146328ea0c4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:57.915312 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f29ed35-a931-47fb-9096-6146328ea0c4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:57.916084 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f29ed35-a931-47fb-9096-6146328ea0c4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:57.916513 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f29ed35-a931-47fb-9096-6146328ea0c4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:57.966893 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-11fb7476-8c8b-4329-92d6-a4db83aa2eaa tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:57.968194 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-11fb7476-8c8b-4329-92d6-a4db83aa2eaa tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:57.975825 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11fb7476-8c8b-4329-92d6-a4db83aa2eaa tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:57.976391 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11fb7476-8c8b-4329-92d6-a4db83aa2eaa tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:57.977160 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11fb7476-8c8b-4329-92d6-a4db83aa2eaa tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:57.977580 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11fb7476-8c8b-4329-92d6-a4db83aa2eaa tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:58.005278 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5f29ed35-a931-47fb-9096-6146328ea0c4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.101962 Oct 28 08:43:58.005922 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 371/750] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:57 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:58.046402 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-11fb7476-8c8b-4329-92d6-a4db83aa2eaa tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.083559 Oct 28 08:43:58.048898 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 380/751] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:57 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:43:58.501464 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-687654be-8dc7-491d-9020-d71de173fc43 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:58.501989 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-687654be-8dc7-491d-9020-d71de173fc43 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:58.515131 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-687654be-8dc7-491d-9020-d71de173fc43 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:58.516183 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-687654be-8dc7-491d-9020-d71de173fc43 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:58.517120 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-687654be-8dc7-491d-9020-d71de173fc43 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:58.517810 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-687654be-8dc7-491d-9020-d71de173fc43 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:58.573926 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-079efa28-10e6-40a8-b096-c648a2bc3768 req-9dd1def2-8a6f-4a76-9710-bb3de1de47b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fecc28dc-ead2-481a-a3a5-7b5702510113", "name": "network-vif-deleted", "tag": "e8d31af7-741e-4880-988e-5bfcf3a45f01"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:58.575479 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:43:58.575479 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:43:58.586191 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-079efa28-10e6-40a8-b096-c648a2bc3768 req-9dd1def2-8a6f-4a76-9710-bb3de1de47b7 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:58.586942 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-079efa28-10e6-40a8-b096-c648a2bc3768 req-9dd1def2-8a6f-4a76-9710-bb3de1de47b7 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:58.599630 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-687654be-8dc7-491d-9020-d71de173fc43 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:58.601022 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-079efa28-10e6-40a8-b096-c648a2bc3768 req-9dd1def2-8a6f-4a76-9710-bb3de1de47b7 service nova] Creating event network-vif-deleted:e8d31af7-741e-4880-988e-5bfcf3a45f01 for instance fecc28dc-ead2-481a-a3a5-7b5702510113 on hv-cinder-81565 Oct 28 08:43:58.606367 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-079efa28-10e6-40a8-b096-c648a2bc3768 req-9dd1def2-8a6f-4a76-9710-bb3de1de47b7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037614 Oct 28 08:43:58.607289 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 381/752] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:43:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:43:58.608272 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-687654be-8dc7-491d-9020-d71de173fc43 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 200 len: 1465 microversion: 2.1 time: 0.111656 Oct 28 08:43:58.608964 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 372/753] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:58 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 1465 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:43:59.018931 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5d5fe398-a01c-414b-a8c0-fa78d22510c4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:59.019860 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5d5fe398-a01c-414b-a8c0-fa78d22510c4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:59.026192 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d5fe398-a01c-414b-a8c0-fa78d22510c4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:59.026534 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d5fe398-a01c-414b-a8c0-fa78d22510c4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:59.027633 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d5fe398-a01c-414b-a8c0-fa78d22510c4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:59.027735 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d5fe398-a01c-414b-a8c0-fa78d22510c4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:59.060888 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b340ae88-b71a-40a6-98ed-85df40fc7d52 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:43:59.061812 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b340ae88-b71a-40a6-98ed-85df40fc7d52 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:59.069060 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b340ae88-b71a-40a6-98ed-85df40fc7d52 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:59.069527 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b340ae88-b71a-40a6-98ed-85df40fc7d52 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:59.070381 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b340ae88-b71a-40a6-98ed-85df40fc7d52 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:59.071011 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b340ae88-b71a-40a6-98ed-85df40fc7d52 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:59.125174 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5d5fe398-a01c-414b-a8c0-fa78d22510c4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.111531 Oct 28 08:43:59.126544 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 382/754] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:43:59 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:43:59.158465 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b340ae88-b71a-40a6-98ed-85df40fc7d52 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.102254 Oct 28 08:43:59.159151 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3c6f4632-1c58-4e22-8b62-d6891f05c1c7 tempest-VolumesTestJSON-661126910 tempest-VolumesTestJSON-661126910-project] Calling method '.version_select at 0x7fed6f179790>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:59.159841 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 373/755] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:43:59 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:43:59.210463 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3c6f4632-1c58-4e22-8b62-d6891f05c1c7 tempest-VolumesTestJSON-661126910 tempest-VolumesTestJSON-661126910-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/276194fa-ed0d-4743-91c5-d341c47f1550" status: 200 len: 350 microversion: 2.1 time: 0.056935 Oct 28 08:43:59.211054 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 383/756] 10.222.0.76 () {58 vars in 1244 bytes} [Thu Oct 28 08:43:59 2021] GET /compute/v2.1/os-volumes/276194fa-ed0d-4743-91c5-d341c47f1550 => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:43:59.626711 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ea45f740-16d6-4fa4-bfeb-0139279d79f5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:59.627413 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ea45f740-16d6-4fa4-bfeb-0139279d79f5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: fecc28dc-ead2-481a-a3a5-7b5702510113] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:59.634149 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea45f740-16d6-4fa4-bfeb-0139279d79f5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:59.634623 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea45f740-16d6-4fa4-bfeb-0139279d79f5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:59.635394 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea45f740-16d6-4fa4-bfeb-0139279d79f5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:59.635826 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea45f740-16d6-4fa4-bfeb-0139279d79f5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:59.650130 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-ea45f740-16d6-4fa4-bfeb-0139279d79f5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] HTTP exception thrown: Instance fecc28dc-ead2-481a-a3a5-7b5702510113 could not be found. Oct 28 08:43:59.650738 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ea45f740-16d6-4fa4-bfeb-0139279d79f5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Returning 404 to user: Instance fecc28dc-ead2-481a-a3a5-7b5702510113 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:43:59.651556 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ea45f740-16d6-4fa4-bfeb-0139279d79f5 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113" status: 404 len: 111 microversion: 2.1 time: 0.029554 Oct 28 08:43:59.652088 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 374/757] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:59 2021] GET /compute/v2.1/servers/fecc28dc-ead2-481a-a3a5-7b5702510113 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:43:59.661196 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e6d59468-fbe6-4281-8ac2-b9cfa111f06e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:59.661797 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e6d59468-fbe6-4281-8ac2-b9cfa111f06e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:59.667974 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6d59468-fbe6-4281-8ac2-b9cfa111f06e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:59.668416 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6d59468-fbe6-4281-8ac2-b9cfa111f06e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:59.669182 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6d59468-fbe6-4281-8ac2-b9cfa111f06e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:59.669607 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6d59468-fbe6-4281-8ac2-b9cfa111f06e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:59.694919 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e6d59468-fbe6-4281-8ac2-b9cfa111f06e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:43:59.774296 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e6d59468-fbe6-4281-8ac2-b9cfa111f06e tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "DELETE /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 204 len: 0 microversion: 2.1 time: 0.117781 Oct 28 08:43:59.775068 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 384/758] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Oct 28 08:43:59 2021] DELETE /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:43:59.783841 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-02455326-dae2-4074-8607-6a11fdd331f3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:43:59.784552 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-02455326-dae2-4074-8607-6a11fdd331f3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:43:59.796179 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02455326-dae2-4074-8607-6a11fdd331f3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:59.796623 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02455326-dae2-4074-8607-6a11fdd331f3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:59.798167 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02455326-dae2-4074-8607-6a11fdd331f3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:43:59.798633 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02455326-dae2-4074-8607-6a11fdd331f3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:43:59.925452 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-02455326-dae2-4074-8607-6a11fdd331f3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:43:59.932918 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-02455326-dae2-4074-8607-6a11fdd331f3 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1522 microversion: 2.1 time: 0.152982 Oct 28 08:43:59.933479 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 375/759] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:43:59 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:00.137600 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-756bb0cb-bbd3-4ccf-b346-32806715796b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:00.138613 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-756bb0cb-bbd3-4ccf-b346-32806715796b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:00.144831 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-756bb0cb-bbd3-4ccf-b346-32806715796b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:00.145265 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-756bb0cb-bbd3-4ccf-b346-32806715796b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:00.146021 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-756bb0cb-bbd3-4ccf-b346-32806715796b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:00.146449 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-756bb0cb-bbd3-4ccf-b346-32806715796b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:00.170916 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-363635d5-10f4-4dd3-bf3e-fe3578da5e78 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:00.171881 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-363635d5-10f4-4dd3-bf3e-fe3578da5e78 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:00.179292 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-363635d5-10f4-4dd3-bf3e-fe3578da5e78 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:00.179728 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-363635d5-10f4-4dd3-bf3e-fe3578da5e78 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:00.180491 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-363635d5-10f4-4dd3-bf3e-fe3578da5e78 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:00.180915 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-363635d5-10f4-4dd3-bf3e-fe3578da5e78 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:02.080406 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-756bb0cb-bbd3-4ccf-b346-32806715796b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 1.946615 Oct 28 08:44:02.085934 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 385/760] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:00 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 1950 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:02.089490 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-363635d5-10f4-4dd3-bf3e-fe3578da5e78 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 1.921541 Oct 28 08:44:02.090275 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 376/761] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:44:00 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 1924 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:44:02.090768 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f257b82b-6348-4dd7-8866-ab1b5d33c398 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:02.092442 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f257b82b-6348-4dd7-8866-ab1b5d33c398 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:02.106482 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f257b82b-6348-4dd7-8866-ab1b5d33c398 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:02.106988 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f257b82b-6348-4dd7-8866-ab1b5d33c398 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:02.107903 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f257b82b-6348-4dd7-8866-ab1b5d33c398 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:02.108480 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f257b82b-6348-4dd7-8866-ab1b5d33c398 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:02.236557 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-f257b82b-6348-4dd7-8866-ab1b5d33c398 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:02.243955 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f257b82b-6348-4dd7-8866-ab1b5d33c398 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1522 microversion: 2.1 time: 0.160610 Oct 28 08:44:02.244528 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 386/762] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:02 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:03.093634 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-37cc264b-354a-4eea-85da-9fc23234b725 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:03.095189 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-37cc264b-354a-4eea-85da-9fc23234b725 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:03.101209 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3bd57110-054b-43cd-80a5-2f2a2f5d1b09 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:03.102176 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3bd57110-054b-43cd-80a5-2f2a2f5d1b09 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:03.102588 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37cc264b-354a-4eea-85da-9fc23234b725 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:03.103043 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37cc264b-354a-4eea-85da-9fc23234b725 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:03.103855 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37cc264b-354a-4eea-85da-9fc23234b725 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:03.104430 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37cc264b-354a-4eea-85da-9fc23234b725 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:03.108366 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3bd57110-054b-43cd-80a5-2f2a2f5d1b09 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:03.108811 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3bd57110-054b-43cd-80a5-2f2a2f5d1b09 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:03.110099 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3bd57110-054b-43cd-80a5-2f2a2f5d1b09 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:03.110626 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3bd57110-054b-43cd-80a5-2f2a2f5d1b09 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:03.556298 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-37cc264b-354a-4eea-85da-9fc23234b725 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.466471 Oct 28 08:44:03.558972 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 377/763] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:03 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:03.561797 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-52f0d5ad-ca92-4579-9a62-4a6a226acba8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:03.562528 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-52f0d5ad-ca92-4579-9a62-4a6a226acba8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:03.569623 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3bd57110-054b-43cd-80a5-2f2a2f5d1b09 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.471820 Oct 28 08:44:03.573523 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52f0d5ad-ca92-4579-9a62-4a6a226acba8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:03.574133 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 387/764] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:44:03 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:44:03.574253 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52f0d5ad-ca92-4579-9a62-4a6a226acba8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:03.574253 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52f0d5ad-ca92-4579-9a62-4a6a226acba8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:03.574253 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52f0d5ad-ca92-4579-9a62-4a6a226acba8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:03.772633 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-52f0d5ad-ca92-4579-9a62-4a6a226acba8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:03.780143 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-52f0d5ad-ca92-4579-9a62-4a6a226acba8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1522 microversion: 2.1 time: 0.221989 Oct 28 08:44:03.780629 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 378/765] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:03 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:04.568947 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e2f8aeef-4689-4845-8a3f-1b9ea0c36c01 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:04.569928 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e2f8aeef-4689-4845-8a3f-1b9ea0c36c01 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:04.576672 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2f8aeef-4689-4845-8a3f-1b9ea0c36c01 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:04.577105 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2f8aeef-4689-4845-8a3f-1b9ea0c36c01 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:04.577868 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2f8aeef-4689-4845-8a3f-1b9ea0c36c01 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:04.578966 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2f8aeef-4689-4845-8a3f-1b9ea0c36c01 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:04.581327 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-12964eba-9ae4-413b-9083-80dd3f43bde8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:04.582280 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-12964eba-9ae4-413b-9083-80dd3f43bde8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:04.588393 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12964eba-9ae4-413b-9083-80dd3f43bde8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:04.588840 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12964eba-9ae4-413b-9083-80dd3f43bde8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:04.589599 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12964eba-9ae4-413b-9083-80dd3f43bde8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:04.590033 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12964eba-9ae4-413b-9083-80dd3f43bde8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:04.662286 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e2f8aeef-4689-4845-8a3f-1b9ea0c36c01 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.097208 Oct 28 08:44:04.663764 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 388/766] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:04 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:04.670555 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-12964eba-9ae4-413b-9083-80dd3f43bde8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.092780 Oct 28 08:44:04.671194 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 379/767] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:44:04 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:44:04.799352 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5d02ff02-ce98-4e80-957a-b7494fb005d8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:04.800128 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5d02ff02-ce98-4e80-957a-b7494fb005d8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:04.807670 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d02ff02-ce98-4e80-957a-b7494fb005d8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:04.808120 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d02ff02-ce98-4e80-957a-b7494fb005d8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:04.808963 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d02ff02-ce98-4e80-957a-b7494fb005d8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:04.809524 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d02ff02-ce98-4e80-957a-b7494fb005d8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:04.932395 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-5d02ff02-ce98-4e80-957a-b7494fb005d8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:04.940356 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5d02ff02-ce98-4e80-957a-b7494fb005d8 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1522 microversion: 2.1 time: 0.146257 Oct 28 08:44:04.940919 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 389/768] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:04 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:05.673905 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-53b4095e-aead-4645-8002-05e08936f340 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:05.674940 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-53b4095e-aead-4645-8002-05e08936f340 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:05.682039 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53b4095e-aead-4645-8002-05e08936f340 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:05.682487 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53b4095e-aead-4645-8002-05e08936f340 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:05.682627 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-05c9caa2-5ee6-446a-ae9e-9da88c8e9f12 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:05.683294 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53b4095e-aead-4645-8002-05e08936f340 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:05.683468 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-05c9caa2-5ee6-446a-ae9e-9da88c8e9f12 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:05.683725 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53b4095e-aead-4645-8002-05e08936f340 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:05.690762 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05c9caa2-5ee6-446a-ae9e-9da88c8e9f12 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:05.691308 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05c9caa2-5ee6-446a-ae9e-9da88c8e9f12 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:05.692118 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05c9caa2-5ee6-446a-ae9e-9da88c8e9f12 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:05.692597 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05c9caa2-5ee6-446a-ae9e-9da88c8e9f12 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:05.749523 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-53b4095e-aead-4645-8002-05e08936f340 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.079677 Oct 28 08:44:05.751343 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 380/769] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:05 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:05.756333 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c9376db0-503c-4c8f-a4ea-429d17950929 tempest-VolumesTestJSON-661126910 tempest-VolumesTestJSON-661126910-project] Calling method '.version_select at 0x7fed6ea814c0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:05.760157 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-05c9caa2-5ee6-446a-ae9e-9da88c8e9f12 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.081263 Oct 28 08:44:05.760822 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 390/770] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:44:05 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:44:05.803385 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c9376db0-503c-4c8f-a4ea-429d17950929 tempest-VolumesTestJSON-661126910 tempest-VolumesTestJSON-661126910-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/7280467d-65f6-4611-aed8-eaa0484da854" status: 200 len: 351 microversion: 2.1 time: 0.050623 Oct 28 08:44:05.803920 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 381/771] 10.222.0.76 () {58 vars in 1244 bytes} [Thu Oct 28 08:44:05 2021] GET /compute/v2.1/os-volumes/7280467d-65f6-4611-aed8-eaa0484da854 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:44:05.815975 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7069f8e7-2427-4150-b810-c1a3dbeb4232 tempest-VolumesTestJSON-661126910 tempest-VolumesTestJSON-661126910-project] Calling method '.version_select at 0x7fed6f2d5310>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:05.895519 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7069f8e7-2427-4150-b810-c1a3dbeb4232 tempest-VolumesTestJSON-661126910 tempest-VolumesTestJSON-661126910-project] 10.222.0.76 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084040 Oct 28 08:44:05.896079 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 391/772] 10.222.0.76 () {58 vars in 1133 bytes} [Thu Oct 28 08:44:05 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:05.908554 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-476bc8bf-8e91-475a-8a1d-7268cd3bb670 tempest-VolumesTestJSON-661126910 tempest-VolumesTestJSON-661126910-project] Calling method '.version_select at 0x7fed6e8fb940>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:05.957474 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0b8cd891-e5ba-49a3-9fdd-1b446fbf9df1 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:05.958189 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0b8cd891-e5ba-49a3-9fdd-1b446fbf9df1 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:05.964126 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b8cd891-e5ba-49a3-9fdd-1b446fbf9df1 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:05.964567 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b8cd891-e5ba-49a3-9fdd-1b446fbf9df1 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:05.965339 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b8cd891-e5ba-49a3-9fdd-1b446fbf9df1 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:05.965744 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b8cd891-e5ba-49a3-9fdd-1b446fbf9df1 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:05.992925 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-476bc8bf-8e91-475a-8a1d-7268cd3bb670 tempest-VolumesTestJSON-661126910 tempest-VolumesTestJSON-661126910-project] 10.222.0.76 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088570 Oct 28 08:44:05.993502 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 382/773] 10.222.0.76 () {58 vars in 1148 bytes} [Thu Oct 28 08:44:05 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:44:06.005408 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a96da227-020b-44db-8ded-f9964f9f9aea tempest-VolumesTestJSON-661126910 tempest-VolumesTestJSON-661126910-project] Calling method '.version_select at 0x7fed6ea81040>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:06.087512 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a96da227-020b-44db-8ded-f9964f9f9aea tempest-VolumesTestJSON-661126910 tempest-VolumesTestJSON-661126910-project] 10.222.0.76 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085376 Oct 28 08:44:06.088906 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 383/774] 10.222.0.76 () {58 vars in 1133 bytes} [Thu Oct 28 08:44:06 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:44:06.101808 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-09d29cf9-3f47-45c7-88f2-0efe2912ae8a tempest-VolumesTestJSON-661126910 tempest-VolumesTestJSON-661126910-project] Calling method '.version_select at 0x7fed6ead44c0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:06.107473 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-0b8cd891-e5ba-49a3-9fdd-1b446fbf9df1 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:06.116014 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0b8cd891-e5ba-49a3-9fdd-1b446fbf9df1 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1522 microversion: 2.1 time: 0.162535 Oct 28 08:44:06.122998 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 392/775] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:05 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:06.183637 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-09d29cf9-3f47-45c7-88f2-0efe2912ae8a tempest-VolumesTestJSON-661126910 tempest-VolumesTestJSON-661126910-project] 10.222.0.76 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086392 Oct 28 08:44:06.184220 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 384/776] 10.222.0.76 () {58 vars in 1166 bytes} [Thu Oct 28 08:44:06 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:44:06.197136 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9fd4e1d0-06c9-4efc-a354-d736ee94a3ce tempest-VolumesTestJSON-661126910 tempest-VolumesTestJSON-661126910-project] Calling method '.version_select at 0x7fed6f2fab80>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:06.277955 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9fd4e1d0-06c9-4efc-a354-d736ee94a3ce tempest-VolumesTestJSON-661126910 tempest-VolumesTestJSON-661126910-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.084757 Oct 28 08:44:06.278546 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 393/777] 10.222.0.76 () {58 vars in 1169 bytes} [Thu Oct 28 08:44:06 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:44:06.290535 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7c1acd63-4361-42ea-b749-cda82f1c99f8 tempest-VolumesTestJSON-661126910 tempest-VolumesTestJSON-661126910-project] Calling method '.version_select at 0x7fed6e9c5670>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:06.372605 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7c1acd63-4361-42ea-b749-cda82f1c99f8 tempest-VolumesTestJSON-661126910 tempest-VolumesTestJSON-661126910-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085608 Oct 28 08:44:06.373375 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 385/778] 10.222.0.76 () {58 vars in 1154 bytes} [Thu Oct 28 08:44:06 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:06.385603 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b93c43b2-4253-4af7-9938-56dd72cc60f8 tempest-VolumesTestJSON-661126910 tempest-VolumesTestJSON-661126910-project] Calling method '.version_select at 0x7fed6f19caf0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:06.470162 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b93c43b2-4253-4af7-9938-56dd72cc60f8 tempest-VolumesTestJSON-661126910 tempest-VolumesTestJSON-661126910-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088523 Oct 28 08:44:06.471044 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 394/779] 10.222.0.76 () {58 vars in 1187 bytes} [Thu Oct 28 08:44:06 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:44:06.482583 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-07f74877-2fe3-4f3a-8df1-bc47a97b6f76 tempest-VolumesTestJSON-661126910 tempest-VolumesTestJSON-661126910-project] Calling method '.version_select at 0x7fed6e8fb940>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:06.561448 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-07f74877-2fe3-4f3a-8df1-bc47a97b6f76 tempest-VolumesTestJSON-661126910 tempest-VolumesTestJSON-661126910-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.082312 Oct 28 08:44:06.562010 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 386/780] 10.222.0.76 () {58 vars in 1154 bytes} [Thu Oct 28 08:44:06 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:06.762430 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2b00efdc-d8e4-4fec-b5c7-5a34107f3132 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:06.763260 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2b00efdc-d8e4-4fec-b5c7-5a34107f3132 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:06.769818 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b00efdc-d8e4-4fec-b5c7-5a34107f3132 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:06.770253 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b00efdc-d8e4-4fec-b5c7-5a34107f3132 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:06.771405 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b00efdc-d8e4-4fec-b5c7-5a34107f3132 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:06.771586 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dc906ace-b8cc-4376-baab-f8904a517712 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:06.772197 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b00efdc-d8e4-4fec-b5c7-5a34107f3132 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:06.772548 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dc906ace-b8cc-4376-baab-f8904a517712 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:06.779487 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc906ace-b8cc-4376-baab-f8904a517712 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:06.779928 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc906ace-b8cc-4376-baab-f8904a517712 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:06.780729 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc906ace-b8cc-4376-baab-f8904a517712 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:06.781371 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc906ace-b8cc-4376-baab-f8904a517712 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:06.850933 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2b00efdc-d8e4-4fec-b5c7-5a34107f3132 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.091381 Oct 28 08:44:06.855151 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 395/781] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:06 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:06.855488 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dc906ace-b8cc-4376-baab-f8904a517712 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.087566 Oct 28 08:44:06.856744 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 387/782] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:44:06 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:44:07.133253 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-11cf2d88-6266-473a-b660-a01816401f90 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:07.133932 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-11cf2d88-6266-473a-b660-a01816401f90 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:07.140898 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11cf2d88-6266-473a-b660-a01816401f90 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:07.141482 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11cf2d88-6266-473a-b660-a01816401f90 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:07.142238 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11cf2d88-6266-473a-b660-a01816401f90 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:07.142696 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11cf2d88-6266-473a-b660-a01816401f90 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:07.273335 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-11cf2d88-6266-473a-b660-a01816401f90 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:07.281672 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-11cf2d88-6266-473a-b660-a01816401f90 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1522 microversion: 2.1 time: 0.151756 Oct 28 08:44:07.286635 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 396/783] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:07 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:07.863974 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d3139614-f76e-4a93-ae83-f25f7525ed34 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:07.865655 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d3139614-f76e-4a93-ae83-f25f7525ed34 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:07.869064 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1496eb92-5eed-4bb7-bbea-d441a2124509 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:07.870085 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1496eb92-5eed-4bb7-bbea-d441a2124509 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:07.872843 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3139614-f76e-4a93-ae83-f25f7525ed34 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:07.873285 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3139614-f76e-4a93-ae83-f25f7525ed34 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:07.874111 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3139614-f76e-4a93-ae83-f25f7525ed34 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:07.875047 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3139614-f76e-4a93-ae83-f25f7525ed34 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:07.877433 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1496eb92-5eed-4bb7-bbea-d441a2124509 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:07.877878 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1496eb92-5eed-4bb7-bbea-d441a2124509 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:07.878691 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1496eb92-5eed-4bb7-bbea-d441a2124509 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:07.879123 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1496eb92-5eed-4bb7-bbea-d441a2124509 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:07.946892 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d3139614-f76e-4a93-ae83-f25f7525ed34 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.086722 Oct 28 08:44:07.947937 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 388/784] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:07 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:07.952618 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1496eb92-5eed-4bb7-bbea-d441a2124509 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.086952 Oct 28 08:44:07.954678 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 397/785] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:44:07 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:44:08.299744 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-04d3cf92-175b-4a6b-9615-8e33e3f11441 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:08.300793 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-04d3cf92-175b-4a6b-9615-8e33e3f11441 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:08.308268 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04d3cf92-175b-4a6b-9615-8e33e3f11441 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:08.308612 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04d3cf92-175b-4a6b-9615-8e33e3f11441 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:08.309393 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04d3cf92-175b-4a6b-9615-8e33e3f11441 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:08.309822 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04d3cf92-175b-4a6b-9615-8e33e3f11441 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:08.439572 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-04d3cf92-175b-4a6b-9615-8e33e3f11441 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:08.449778 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-04d3cf92-175b-4a6b-9615-8e33e3f11441 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1522 microversion: 2.1 time: 0.154455 Oct 28 08:44:08.450581 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 389/786] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:08 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:08.962815 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-425866ef-7401-4464-93c5-508ec5753b56 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:08.965206 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-425866ef-7401-4464-93c5-508ec5753b56 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:08.965984 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b696b3bc-7c88-4fd2-a161-927878702c78 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:08.966949 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b696b3bc-7c88-4fd2-a161-927878702c78 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:08.974092 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b696b3bc-7c88-4fd2-a161-927878702c78 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:08.974563 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b696b3bc-7c88-4fd2-a161-927878702c78 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:08.975345 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b696b3bc-7c88-4fd2-a161-927878702c78 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:08.975764 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b696b3bc-7c88-4fd2-a161-927878702c78 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:08.976273 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-425866ef-7401-4464-93c5-508ec5753b56 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:08.976792 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-425866ef-7401-4464-93c5-508ec5753b56 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:08.977667 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-425866ef-7401-4464-93c5-508ec5753b56 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:08.978218 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-425866ef-7401-4464-93c5-508ec5753b56 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:09.045245 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b696b3bc-7c88-4fd2-a161-927878702c78 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.083090 Oct 28 08:44:09.045846 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 390/787] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:44:08 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:44:09.048914 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-425866ef-7401-4464-93c5-508ec5753b56 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.091358 Oct 28 08:44:09.049767 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 398/788] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:08 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:09.292498 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-2fa8a993-83e8-4c18-aae8-84a92f6375d1 req-00d4757b-f514-4120-8b52-f8b1fdfbf564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a432ca47-c48c-4e08-8b76-0025d9ef360b", "name": "network-vif-deleted", "tag": "62e8969b-1684-48c9-a697-1e36b8bae48e"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:09.294195 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:44:09.294195 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:44:09.303712 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2fa8a993-83e8-4c18-aae8-84a92f6375d1 req-00d4757b-f514-4120-8b52-f8b1fdfbf564 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:09.304168 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2fa8a993-83e8-4c18-aae8-84a92f6375d1 req-00d4757b-f514-4120-8b52-f8b1fdfbf564 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:09.316611 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-2fa8a993-83e8-4c18-aae8-84a92f6375d1 req-00d4757b-f514-4120-8b52-f8b1fdfbf564 service nova] Creating event network-vif-deleted:62e8969b-1684-48c9-a697-1e36b8bae48e for instance a432ca47-c48c-4e08-8b76-0025d9ef360b on hv-cinder-81565 Oct 28 08:44:09.321807 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-2fa8a993-83e8-4c18-aae8-84a92f6375d1 req-00d4757b-f514-4120-8b52-f8b1fdfbf564 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033356 Oct 28 08:44:09.322398 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 391/789] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:44:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:44:09.467713 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e4725e6e-bfa0-443a-86d4-b93f4021f876 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:09.468479 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e4725e6e-bfa0-443a-86d4-b93f4021f876 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:09.475598 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4725e6e-bfa0-443a-86d4-b93f4021f876 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:09.476038 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4725e6e-bfa0-443a-86d4-b93f4021f876 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:09.476795 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4725e6e-bfa0-443a-86d4-b93f4021f876 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:09.477219 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4725e6e-bfa0-443a-86d4-b93f4021f876 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:09.509574 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4725e6e-bfa0-443a-86d4-b93f4021f876 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:09.510020 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4725e6e-bfa0-443a-86d4-b93f4021f876 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:09.510464 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-e4725e6e-bfa0-443a-86d4-b93f4021f876 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lazy-loading 'fault' on Instance uuid a432ca47-c48c-4e08-8b76-0025d9ef360b {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:44:09.552339 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-e4725e6e-bfa0-443a-86d4-b93f4021f876 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaeb0fe842e54e3b9f0750069d83231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b556f8519472bb4fbe40400334a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:09.560182 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e4725e6e-bfa0-443a-86d4-b93f4021f876 tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 200 len: 1312 microversion: 2.1 time: 0.096371 Oct 28 08:44:09.560687 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 399/790] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:09 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:10.058311 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-554afa2d-cd81-4e8b-95e2-244bb9cd21ae tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:10.059348 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-554afa2d-cd81-4e8b-95e2-244bb9cd21ae tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:10.061002 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7bd4b7b0-aadf-4576-830a-98cfa8afb45d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:10.061929 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7bd4b7b0-aadf-4576-830a-98cfa8afb45d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:10.066039 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-554afa2d-cd81-4e8b-95e2-244bb9cd21ae tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:10.066535 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-554afa2d-cd81-4e8b-95e2-244bb9cd21ae tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:10.067564 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-554afa2d-cd81-4e8b-95e2-244bb9cd21ae tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:10.068004 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-554afa2d-cd81-4e8b-95e2-244bb9cd21ae tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:10.068173 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7bd4b7b0-aadf-4576-830a-98cfa8afb45d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:10.068820 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7bd4b7b0-aadf-4576-830a-98cfa8afb45d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:10.069603 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7bd4b7b0-aadf-4576-830a-98cfa8afb45d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:10.070038 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7bd4b7b0-aadf-4576-830a-98cfa8afb45d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:10.142828 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7bd4b7b0-aadf-4576-830a-98cfa8afb45d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.085286 Oct 28 08:44:10.147037 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-554afa2d-cd81-4e8b-95e2-244bb9cd21ae tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.092908 Oct 28 08:44:10.147716 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 392/791] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:44:10 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:44:10.152172 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 400/792] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:10 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:44:10.580859 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a0abc101-baf4-4f26-85ca-389137dc06cf tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:10.581688 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a0abc101-baf4-4f26-85ca-389137dc06cf tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] [instance: a432ca47-c48c-4e08-8b76-0025d9ef360b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:10.588567 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0abc101-baf4-4f26-85ca-389137dc06cf tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:10.589047 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0abc101-baf4-4f26-85ca-389137dc06cf tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:10.589822 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0abc101-baf4-4f26-85ca-389137dc06cf tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:10.590181 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0abc101-baf4-4f26-85ca-389137dc06cf tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:10.611255 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-a0abc101-baf4-4f26-85ca-389137dc06cf tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] HTTP exception thrown: Instance a432ca47-c48c-4e08-8b76-0025d9ef360b could not be found. Oct 28 08:44:10.611993 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a0abc101-baf4-4f26-85ca-389137dc06cf tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] Returning 404 to user: Instance a432ca47-c48c-4e08-8b76-0025d9ef360b could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:44:10.612817 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a0abc101-baf4-4f26-85ca-389137dc06cf tempest-ServerRescueNegativeTestJSON-203810950 tempest-ServerRescueNegativeTestJSON-203810950-project] 10.222.0.76 "GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b" status: 404 len: 111 microversion: 2.1 time: 0.037520 Oct 28 08:44:10.613591 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 393/793] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:10 2021] GET /compute/v2.1/servers/a432ca47-c48c-4e08-8b76-0025d9ef360b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 08:44:11.161983 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f5cded2a-54e1-4c8f-b971-247b794cb596 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:11.166988 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1abd595b-6912-465e-8fbb-4592ab9850a4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:11.167906 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1abd595b-6912-465e-8fbb-4592ab9850a4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:11.168729 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f5cded2a-54e1-4c8f-b971-247b794cb596 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:11.184446 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1abd595b-6912-465e-8fbb-4592ab9850a4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:11.185077 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1abd595b-6912-465e-8fbb-4592ab9850a4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:11.186035 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1abd595b-6912-465e-8fbb-4592ab9850a4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:11.186323 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5cded2a-54e1-4c8f-b971-247b794cb596 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:11.187668 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1abd595b-6912-465e-8fbb-4592ab9850a4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:11.188025 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5cded2a-54e1-4c8f-b971-247b794cb596 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:11.192228 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5cded2a-54e1-4c8f-b971-247b794cb596 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:11.192869 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5cded2a-54e1-4c8f-b971-247b794cb596 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:11.294180 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f5cded2a-54e1-4c8f-b971-247b794cb596 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.127733 Oct 28 08:44:11.297065 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 401/794] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:11 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:11.307827 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1abd595b-6912-465e-8fbb-4592ab9850a4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.151283 Oct 28 08:44:11.309868 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 394/795] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:44:11 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:44:12.321661 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-55fae4b8-b21f-4f55-bf28-464136208705 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:12.322753 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fd6618e4-2360-42a9-9ad6-7adb3c8d975c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:12.323179 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-55fae4b8-b21f-4f55-bf28-464136208705 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:12.324794 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fd6618e4-2360-42a9-9ad6-7adb3c8d975c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:12.331815 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55fae4b8-b21f-4f55-bf28-464136208705 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:12.332337 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55fae4b8-b21f-4f55-bf28-464136208705 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:12.333283 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55fae4b8-b21f-4f55-bf28-464136208705 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:12.333669 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55fae4b8-b21f-4f55-bf28-464136208705 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:12.336010 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd6618e4-2360-42a9-9ad6-7adb3c8d975c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:12.336779 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd6618e4-2360-42a9-9ad6-7adb3c8d975c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:12.337643 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd6618e4-2360-42a9-9ad6-7adb3c8d975c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:12.338140 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd6618e4-2360-42a9-9ad6-7adb3c8d975c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:12.416767 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fd6618e4-2360-42a9-9ad6-7adb3c8d975c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.111784 Oct 28 08:44:12.417683 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 402/796] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:12 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:12.419788 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-55fae4b8-b21f-4f55-bf28-464136208705 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.102225 Oct 28 08:44:12.420413 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 395/797] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:44:12 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:44:13.430259 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-052770b4-5ff1-410c-8c4e-f0025f744859 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:13.431421 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-052770b4-5ff1-410c-8c4e-f0025f744859 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:13.433811 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-32a62e90-c0da-4315-a051-954c62da4b9b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:13.434958 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-32a62e90-c0da-4315-a051-954c62da4b9b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:13.440326 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-052770b4-5ff1-410c-8c4e-f0025f744859 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:13.440772 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-052770b4-5ff1-410c-8c4e-f0025f744859 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:13.441592 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-052770b4-5ff1-410c-8c4e-f0025f744859 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:13.442215 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-052770b4-5ff1-410c-8c4e-f0025f744859 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:13.444276 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-32a62e90-c0da-4315-a051-954c62da4b9b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:13.444788 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-32a62e90-c0da-4315-a051-954c62da4b9b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:13.445626 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-32a62e90-c0da-4315-a051-954c62da4b9b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:13.446114 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-32a62e90-c0da-4315-a051-954c62da4b9b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:13.516507 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-052770b4-5ff1-410c-8c4e-f0025f744859 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.088982 Oct 28 08:44:13.519915 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 403/798] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:13 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:13.523450 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-32a62e90-c0da-4315-a051-954c62da4b9b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.094859 Oct 28 08:44:13.524201 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 396/799] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:44:13 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:44:14.532178 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bdb9f9b6-9ece-45e6-b3c8-7e10143f9191 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:14.533252 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bdb9f9b6-9ece-45e6-b3c8-7e10143f9191 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:14.536772 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9dc15f66-5234-4b1f-8419-e5a9004a7148 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:14.537784 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9dc15f66-5234-4b1f-8419-e5a9004a7148 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:14.540619 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdb9f9b6-9ece-45e6-b3c8-7e10143f9191 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:14.541092 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdb9f9b6-9ece-45e6-b3c8-7e10143f9191 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:14.541899 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdb9f9b6-9ece-45e6-b3c8-7e10143f9191 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:14.542359 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdb9f9b6-9ece-45e6-b3c8-7e10143f9191 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:14.544465 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dc15f66-5234-4b1f-8419-e5a9004a7148 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:14.544904 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dc15f66-5234-4b1f-8419-e5a9004a7148 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:14.545879 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dc15f66-5234-4b1f-8419-e5a9004a7148 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:14.546683 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dc15f66-5234-4b1f-8419-e5a9004a7148 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:14.613354 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bdb9f9b6-9ece-45e6-b3c8-7e10143f9191 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.085506 Oct 28 08:44:14.614068 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 404/800] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:14 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:14.637773 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9dc15f66-5234-4b1f-8419-e5a9004a7148 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.104911 Oct 28 08:44:14.642636 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 397/801] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:44:14 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:44:15.627079 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-93bad96c-4531-49e1-b3e3-0d4c8c38bff7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:15.628073 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-93bad96c-4531-49e1-b3e3-0d4c8c38bff7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:15.634411 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93bad96c-4531-49e1-b3e3-0d4c8c38bff7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:15.634940 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93bad96c-4531-49e1-b3e3-0d4c8c38bff7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:15.635827 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93bad96c-4531-49e1-b3e3-0d4c8c38bff7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:15.636257 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93bad96c-4531-49e1-b3e3-0d4c8c38bff7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:15.636951 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dd7822d4-f79c-4e82-8ade-2d6b5900af03 tempest-VolumesNegativeTest-416695962 tempest-VolumesNegativeTest-416695962-project] Action: 'create', calling method: .version_select at 0x7fed6f280ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-4211636", "metadata": {"Type": "work"}}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:15.639081 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dd7822d4-f79c-4e82-8ade-2d6b5900af03 tempest-VolumesNegativeTest-416695962 tempest-VolumesNegativeTest-416695962-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:44:15.639903 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dd7822d4-f79c-4e82-8ade-2d6b5900af03 tempest-VolumesNegativeTest-416695962 tempest-VolumesNegativeTest-416695962-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.253053 Oct 28 08:44:15.642529 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 405/802] 10.222.0.76 () {60 vars in 1155 bytes} [Thu Oct 28 08:44:15 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 254 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 08:44:15.649603 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-24dab91c-4f17-42e3-ac70-6b45bd859474 tempest-VolumesNegativeTest-416695962 tempest-VolumesNegativeTest-416695962-project] Action: 'create', calling method: .version_select at 0x7fed6f19c8b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2085757166", "metadata": {"Type": "work"}}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:15.651103 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-24dab91c-4f17-42e3-ac70-6b45bd859474 tempest-VolumesNegativeTest-416695962 tempest-VolumesNegativeTest-416695962-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:44:15.652080 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-24dab91c-4f17-42e3-ac70-6b45bd859474 tempest-VolumesNegativeTest-416695962 tempest-VolumesNegativeTest-416695962-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006258 Oct 28 08:44:15.653039 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 406/803] 10.222.0.76 () {60 vars in 1155 bytes} [Thu Oct 28 08:44:15 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 08:44:15.658074 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-44129d4f-4f80-41d7-b8d2-3f5310367173 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:15.659182 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-44129d4f-4f80-41d7-b8d2-3f5310367173 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:15.666768 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44129d4f-4f80-41d7-b8d2-3f5310367173 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:15.667259 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44129d4f-4f80-41d7-b8d2-3f5310367173 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:15.668562 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44129d4f-4f80-41d7-b8d2-3f5310367173 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:15.669331 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44129d4f-4f80-41d7-b8d2-3f5310367173 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:15.710300 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-93bad96c-4531-49e1-b3e3-0d4c8c38bff7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.088196 Oct 28 08:44:15.711076 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 398/804] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:15 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:44:15.716305 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6c94eda9-8b98-4943-a0ca-ed0a2277a69c tempest-VolumesNegativeTest-416695962 tempest-VolumesNegativeTest-416695962-project] Action: 'create', calling method: .version_select at 0x7fed6e974040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1157025814", "metadata": {"Type": "work"}}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:15.717933 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6c94eda9-8b98-4943-a0ca-ed0a2277a69c tempest-VolumesNegativeTest-416695962 tempest-VolumesNegativeTest-416695962-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:44:15.718847 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6c94eda9-8b98-4943-a0ca-ed0a2277a69c tempest-VolumesNegativeTest-416695962 tempest-VolumesNegativeTest-416695962-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006619 Oct 28 08:44:15.719466 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 399/805] 10.222.0.76 () {60 vars in 1155 bytes} [Thu Oct 28 08:44:15 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 08:44:15.729437 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8df0a183-594a-46ff-a710-95c2b4be1e0a tempest-VolumesNegativeTest-416695962 tempest-VolumesNegativeTest-416695962-project] Calling method '.version_select at 0x7fed6e8d6af0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:15.742649 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-44129d4f-4f80-41d7-b8d2-3f5310367173 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 28665 microversion: 2.1 time: 0.088217 Oct 28 08:44:15.743450 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 407/806] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:44:15 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 28665 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:44:15.760527 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-8df0a183-594a-46ff-a710-95c2b4be1e0a tempest-VolumesNegativeTest-416695962 tempest-VolumesNegativeTest-416695962-project] HTTP exception thrown: Volume tempest-invalid-1291325318 could not be found. Oct 28 08:44:15.761181 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8df0a183-594a-46ff-a710-95c2b4be1e0a tempest-VolumesNegativeTest-416695962 tempest-VolumesNegativeTest-416695962-project] Returning 404 to user: Volume tempest-invalid-1291325318 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:44:15.761999 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8df0a183-594a-46ff-a710-95c2b4be1e0a tempest-VolumesNegativeTest-416695962 tempest-VolumesNegativeTest-416695962-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1291325318" status: 404 len: 99 microversion: 2.1 time: 0.036937 Oct 28 08:44:15.762629 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 400/807] 10.222.0.76 () {58 vars in 1217 bytes} [Thu Oct 28 08:44:15 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1291325318 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 08:44:15.773079 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-39f78da7-5a4f-4707-9ffc-9bc884a2a570 tempest-VolumesNegativeTest-416695962 tempest-VolumesNegativeTest-416695962-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004265 Oct 28 08:44:15.773580 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 408/808] 10.222.0.76 () {58 vars in 1139 bytes} [Thu Oct 28 08:44:15 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 08:44:15.783357 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a59fb652-6458-4654-b3f8-802026a902f1 tempest-VolumesNegativeTest-416695962 tempest-VolumesNegativeTest-416695962-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004657 Oct 28 08:44:15.783859 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 401/809] 10.222.0.76 () {58 vars in 1136 bytes} [Thu Oct 28 08:44:15 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 28 08:44:15.801390 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cc5963fb-367a-4c6f-b620-7b2bfd3fbf22 tempest-VolumesNegativeTest-416695962 tempest-VolumesNegativeTest-416695962-project] Calling method '.version_select at 0x7fed6f4879d0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:15.829951 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-cc5963fb-367a-4c6f-b620-7b2bfd3fbf22 tempest-VolumesNegativeTest-416695962 tempest-VolumesNegativeTest-416695962-project] HTTP exception thrown: Volume 6f619843-38d0-4937-bf2f-dd07b43be278 could not be found. Oct 28 08:44:15.830593 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cc5963fb-367a-4c6f-b620-7b2bfd3fbf22 tempest-VolumesNegativeTest-416695962 tempest-VolumesNegativeTest-416695962-project] Returning 404 to user: Volume 6f619843-38d0-4937-bf2f-dd07b43be278 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:44:15.831613 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cc5963fb-367a-4c6f-b620-7b2bfd3fbf22 tempest-VolumesNegativeTest-416695962 tempest-VolumesNegativeTest-416695962-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/6f619843-38d0-4937-bf2f-dd07b43be278" status: 404 len: 109 microversion: 2.1 time: 0.042629 Oct 28 08:44:15.832155 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 409/810] 10.222.0.76 () {58 vars in 1247 bytes} [Thu Oct 28 08:44:15 2021] DELETE /compute/v2.1/os-volumes/6f619843-38d0-4937-bf2f-dd07b43be278 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 08:44:15.842400 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8fc94f47-331d-406a-b29f-9ecfb47a7124 tempest-VolumesNegativeTest-416695962 tempest-VolumesNegativeTest-416695962-project] Calling method '.version_select at 0x7fed6e8d6ca0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:15.870994 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-8fc94f47-331d-406a-b29f-9ecfb47a7124 tempest-VolumesNegativeTest-416695962 tempest-VolumesNegativeTest-416695962-project] HTTP exception thrown: Volume 7a5dd3e1-3546-4967-9b9d-0ed236e8ef87 could not be found. Oct 28 08:44:15.871699 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8fc94f47-331d-406a-b29f-9ecfb47a7124 tempest-VolumesNegativeTest-416695962 tempest-VolumesNegativeTest-416695962-project] Returning 404 to user: Volume 7a5dd3e1-3546-4967-9b9d-0ed236e8ef87 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:44:15.872604 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8fc94f47-331d-406a-b29f-9ecfb47a7124 tempest-VolumesNegativeTest-416695962 tempest-VolumesNegativeTest-416695962-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/7a5dd3e1-3546-4967-9b9d-0ed236e8ef87" status: 404 len: 109 microversion: 2.1 time: 0.035185 Oct 28 08:44:15.873270 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 402/811] 10.222.0.76 () {58 vars in 1244 bytes} [Thu Oct 28 08:44:15 2021] GET /compute/v2.1/os-volumes/7a5dd3e1-3546-4967-9b9d-0ed236e8ef87 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:44:16.726402 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cddf1d3d-9b35-40cd-b024-2d29c68a1e94 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:16.728464 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cddf1d3d-9b35-40cd-b024-2d29c68a1e94 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:16.741523 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cddf1d3d-9b35-40cd-b024-2d29c68a1e94 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:16.742699 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cddf1d3d-9b35-40cd-b024-2d29c68a1e94 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:16.744325 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cddf1d3d-9b35-40cd-b024-2d29c68a1e94 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:16.744991 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cddf1d3d-9b35-40cd-b024-2d29c68a1e94 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:16.757535 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b943f1a9-3c32-431a-a3e8-2d945de4f4b9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:16.759086 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b943f1a9-3c32-431a-a3e8-2d945de4f4b9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:16.768871 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b943f1a9-3c32-431a-a3e8-2d945de4f4b9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:16.769468 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b943f1a9-3c32-431a-a3e8-2d945de4f4b9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:16.770492 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b943f1a9-3c32-431a-a3e8-2d945de4f4b9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:16.771262 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b943f1a9-3c32-431a-a3e8-2d945de4f4b9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:16.859478 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cddf1d3d-9b35-40cd-b024-2d29c68a1e94 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 28610 microversion: 2.20 time: 0.137244 Oct 28 08:44:16.861259 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 410/812] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:16 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 28610 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:16.872077 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b943f1a9-3c32-431a-a3e8-2d945de4f4b9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 29330 microversion: 2.1 time: 0.119152 Oct 28 08:44:16.876714 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 403/813] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:44:16 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 29330 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:44:17.872944 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e5b67da4-ca14-480f-b43a-b3b9491824d6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:17.874107 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e5b67da4-ca14-480f-b43a-b3b9491824d6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:17.881617 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5b67da4-ca14-480f-b43a-b3b9491824d6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:17.882422 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5b67da4-ca14-480f-b43a-b3b9491824d6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:17.883731 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5b67da4-ca14-480f-b43a-b3b9491824d6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:17.884380 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5b67da4-ca14-480f-b43a-b3b9491824d6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:17.886772 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9fb99544-2a09-4aa5-8b92-1eea5fa7a107 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:17.888294 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9fb99544-2a09-4aa5-8b92-1eea5fa7a107 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:17.898272 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9fb99544-2a09-4aa5-8b92-1eea5fa7a107 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:17.898743 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9fb99544-2a09-4aa5-8b92-1eea5fa7a107 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:17.900499 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9fb99544-2a09-4aa5-8b92-1eea5fa7a107 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:17.901193 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9fb99544-2a09-4aa5-8b92-1eea5fa7a107 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:17.976268 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e5b67da4-ca14-480f-b43a-b3b9491824d6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 29221 microversion: 2.20 time: 0.107508 Oct 28 08:44:17.977384 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 411/814] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:17 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 29221 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:18.009037 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9fb99544-2a09-4aa5-8b92-1eea5fa7a107 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 31398 microversion: 2.1 time: 0.126766 Oct 28 08:44:18.013116 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 404/815] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:44:17 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 31398 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:44:18.989943 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-44256eaa-5090-4f89-81ee-49de3e8382d8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:18.990956 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-44256eaa-5090-4f89-81ee-49de3e8382d8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:19.001423 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44256eaa-5090-4f89-81ee-49de3e8382d8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:19.002319 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44256eaa-5090-4f89-81ee-49de3e8382d8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:19.003796 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44256eaa-5090-4f89-81ee-49de3e8382d8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:19.004254 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44256eaa-5090-4f89-81ee-49de3e8382d8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:19.021174 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-59f89d28-1768-4b1c-99ed-5e3caae76d94 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:19.022556 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-59f89d28-1768-4b1c-99ed-5e3caae76d94 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:19.038774 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59f89d28-1768-4b1c-99ed-5e3caae76d94 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:19.048882 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59f89d28-1768-4b1c-99ed-5e3caae76d94 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:19.049885 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59f89d28-1768-4b1c-99ed-5e3caae76d94 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:19.050625 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59f89d28-1768-4b1c-99ed-5e3caae76d94 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:19.152758 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-44256eaa-5090-4f89-81ee-49de3e8382d8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 31252 microversion: 2.20 time: 0.166323 Oct 28 08:44:19.153564 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 412/816] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:18 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 31252 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:19.180161 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-59f89d28-1768-4b1c-99ed-5e3caae76d94 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 33153 microversion: 2.1 time: 0.162473 Oct 28 08:44:19.181760 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 405/817] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:44:19 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 33153 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:44:20.166995 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4d447628-1f1f-40c6-a87a-8c3a75084b17 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:20.180871 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4d447628-1f1f-40c6-a87a-8c3a75084b17 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:20.198071 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-64d64b67-c3c1-40fd-bb35-6881d60ee1b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:20.200098 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-64d64b67-c3c1-40fd-bb35-6881d60ee1b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:20.209767 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64d64b67-c3c1-40fd-bb35-6881d60ee1b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:20.209923 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d447628-1f1f-40c6-a87a-8c3a75084b17 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:20.210330 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d447628-1f1f-40c6-a87a-8c3a75084b17 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:20.210946 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64d64b67-c3c1-40fd-bb35-6881d60ee1b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:20.212014 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64d64b67-c3c1-40fd-bb35-6881d60ee1b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:20.213896 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64d64b67-c3c1-40fd-bb35-6881d60ee1b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:20.217653 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d447628-1f1f-40c6-a87a-8c3a75084b17 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:20.218184 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d447628-1f1f-40c6-a87a-8c3a75084b17 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:20.357836 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-64d64b67-c3c1-40fd-bb35-6881d60ee1b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 34232 microversion: 2.1 time: 0.167490 Oct 28 08:44:20.363087 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 406/818] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:44:20 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 34232 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:44:20.387551 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4d447628-1f1f-40c6-a87a-8c3a75084b17 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 32726 microversion: 2.20 time: 0.225641 Oct 28 08:44:20.389407 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 413/819] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:20 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 32726 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:21.369963 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4c2d420c-f2e9-4b16-ba7f-79dc279f4118 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:21.371908 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4c2d420c-f2e9-4b16-ba7f-79dc279f4118 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:21.380386 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c2d420c-f2e9-4b16-ba7f-79dc279f4118 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:21.380902 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c2d420c-f2e9-4b16-ba7f-79dc279f4118 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:21.381958 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c2d420c-f2e9-4b16-ba7f-79dc279f4118 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:21.383320 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c2d420c-f2e9-4b16-ba7f-79dc279f4118 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:21.402443 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b0337a4b-b7ea-43f5-94aa-ad1984613a85 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:21.403666 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b0337a4b-b7ea-43f5-94aa-ad1984613a85 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:21.416359 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0337a4b-b7ea-43f5-94aa-ad1984613a85 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:21.417353 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0337a4b-b7ea-43f5-94aa-ad1984613a85 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:21.418192 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0337a4b-b7ea-43f5-94aa-ad1984613a85 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:21.419936 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0337a4b-b7ea-43f5-94aa-ad1984613a85 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:21.468616 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4c2d420c-f2e9-4b16-ba7f-79dc279f4118 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 35420 microversion: 2.1 time: 0.102082 Oct 28 08:44:21.470377 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 407/820] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:44:21 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 35420 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:44:21.512416 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b0337a4b-b7ea-43f5-94aa-ad1984613a85 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 33696 microversion: 2.20 time: 0.114311 Oct 28 08:44:21.513424 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 414/821] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:21 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 33696 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:22.482211 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f545d32d-0262-4914-87ee-396aa4498451 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:22.483353 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f545d32d-0262-4914-87ee-396aa4498451 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:22.495709 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f545d32d-0262-4914-87ee-396aa4498451 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:22.496051 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f545d32d-0262-4914-87ee-396aa4498451 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:22.496845 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f545d32d-0262-4914-87ee-396aa4498451 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:22.497275 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f545d32d-0262-4914-87ee-396aa4498451 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:22.526160 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-39ce04e0-b70b-496d-a3bd-55e18ac133dd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:22.527387 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-39ce04e0-b70b-496d-a3bd-55e18ac133dd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:22.537796 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39ce04e0-b70b-496d-a3bd-55e18ac133dd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:22.539153 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39ce04e0-b70b-496d-a3bd-55e18ac133dd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:22.539956 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39ce04e0-b70b-496d-a3bd-55e18ac133dd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:22.540392 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39ce04e0-b70b-496d-a3bd-55e18ac133dd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:22.616475 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f545d32d-0262-4914-87ee-396aa4498451 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 36830 microversion: 2.1 time: 0.138333 Oct 28 08:44:22.617132 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 408/822] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:44:22 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 36830 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:44:22.633952 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-39ce04e0-b70b-496d-a3bd-55e18ac133dd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 34924 microversion: 2.20 time: 0.111880 Oct 28 08:44:22.634647 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 415/823] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:22 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 34924 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:44:23.630024 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-399ff682-7de2-4d97-8997-cbf0494d29eb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:23.631344 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-399ff682-7de2-4d97-8997-cbf0494d29eb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:23.645084 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-399ff682-7de2-4d97-8997-cbf0494d29eb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:23.645527 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-399ff682-7de2-4d97-8997-cbf0494d29eb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:23.646898 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9b859b64-2862-47b7-85c6-bed2d3d871a4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:23.648107 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-399ff682-7de2-4d97-8997-cbf0494d29eb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:23.648556 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-399ff682-7de2-4d97-8997-cbf0494d29eb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:23.649060 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9b859b64-2862-47b7-85c6-bed2d3d871a4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:23.659284 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b859b64-2862-47b7-85c6-bed2d3d871a4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:23.660273 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b859b64-2862-47b7-85c6-bed2d3d871a4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:23.662086 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b859b64-2862-47b7-85c6-bed2d3d871a4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:23.662804 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b859b64-2862-47b7-85c6-bed2d3d871a4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:23.771803 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-399ff682-7de2-4d97-8997-cbf0494d29eb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 38199 microversion: 2.1 time: 0.145605 Oct 28 08:44:23.772789 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 409/824] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:44:23 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 38199 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:44:23.802998 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9b859b64-2862-47b7-85c6-bed2d3d871a4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 36455 microversion: 2.20 time: 0.159763 Oct 28 08:44:23.808845 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 416/825] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:23 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 36455 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:44:24.805074 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c93bf075-3f12-421c-bae2-89de63e3e08c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:24.807313 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c93bf075-3f12-421c-bae2-89de63e3e08c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:24.819440 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c93bf075-3f12-421c-bae2-89de63e3e08c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:24.820290 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c93bf075-3f12-421c-bae2-89de63e3e08c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:24.821285 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c93bf075-3f12-421c-bae2-89de63e3e08c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:24.821753 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c0e212ff-d9f0-48c3-87a0-456390411f0d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:24.822578 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c93bf075-3f12-421c-bae2-89de63e3e08c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:24.823052 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c0e212ff-d9f0-48c3-87a0-456390411f0d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:24.831807 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0e212ff-d9f0-48c3-87a0-456390411f0d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:24.837032 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0e212ff-d9f0-48c3-87a0-456390411f0d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:24.838105 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0e212ff-d9f0-48c3-87a0-456390411f0d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:24.838735 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0e212ff-d9f0-48c3-87a0-456390411f0d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:24.900527 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c93bf075-3f12-421c-bae2-89de63e3e08c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 38199 microversion: 2.1 time: 0.118158 Oct 28 08:44:24.901753 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 410/826] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:44:24 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 38199 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:44:24.948332 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c0e212ff-d9f0-48c3-87a0-456390411f0d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 38031 microversion: 2.20 time: 0.134562 Oct 28 08:44:24.957478 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 417/827] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:24 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 38031 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:25.931656 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-31eb198a-2dd0-491f-adb4-caa4a18d057f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:25.935662 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-31eb198a-2dd0-491f-adb4-caa4a18d057f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:25.946666 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31eb198a-2dd0-491f-adb4-caa4a18d057f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:25.947193 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31eb198a-2dd0-491f-adb4-caa4a18d057f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:25.948208 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31eb198a-2dd0-491f-adb4-caa4a18d057f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:25.948921 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31eb198a-2dd0-491f-adb4-caa4a18d057f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:25.966149 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-adf28639-b24b-4d2f-b83d-ee9fe7c26e06 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:25.967284 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-adf28639-b24b-4d2f-b83d-ee9fe7c26e06 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:25.984313 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-adf28639-b24b-4d2f-b83d-ee9fe7c26e06 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:25.987657 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-adf28639-b24b-4d2f-b83d-ee9fe7c26e06 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:25.988639 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-adf28639-b24b-4d2f-b83d-ee9fe7c26e06 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:25.989090 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-adf28639-b24b-4d2f-b83d-ee9fe7c26e06 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:26.052484 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-31eb198a-2dd0-491f-adb4-caa4a18d057f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 38199 microversion: 2.1 time: 0.132829 Oct 28 08:44:26.053922 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 411/828] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:44:25 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 38199 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:44:26.132797 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-adf28639-b24b-4d2f-b83d-ee9fe7c26e06 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 38165 microversion: 2.20 time: 0.169783 Oct 28 08:44:26.133854 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 418/829] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:25 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 38165 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:27.066717 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7f4b8d97-df3f-48ca-9158-8ea64078fcc7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:27.068733 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7f4b8d97-df3f-48ca-9158-8ea64078fcc7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:27.101885 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f4b8d97-df3f-48ca-9158-8ea64078fcc7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:27.104426 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f4b8d97-df3f-48ca-9158-8ea64078fcc7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:27.108897 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f4b8d97-df3f-48ca-9158-8ea64078fcc7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:27.112616 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f4b8d97-df3f-48ca-9158-8ea64078fcc7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:27.149906 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f449d691-94cc-4bee-94ab-645f861233db tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:27.151049 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f449d691-94cc-4bee-94ab-645f861233db tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:27.171255 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f449d691-94cc-4bee-94ab-645f861233db tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:27.174060 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f449d691-94cc-4bee-94ab-645f861233db tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:27.182377 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f449d691-94cc-4bee-94ab-645f861233db tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:27.190860 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f449d691-94cc-4bee-94ab-645f861233db tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:27.249884 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7f4b8d97-df3f-48ca-9158-8ea64078fcc7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 38199 microversion: 2.1 time: 0.188333 Oct 28 08:44:27.252368 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 412/830] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:44:27 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 38199 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:44:27.388848 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f449d691-94cc-4bee-94ab-645f861233db tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 38165 microversion: 2.20 time: 0.245622 Oct 28 08:44:27.390777 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 419/831] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:27 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 38165 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:28.282817 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0404093e-c61a-42f7-9de5-8ca0cc728165 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:28.285987 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0404093e-c61a-42f7-9de5-8ca0cc728165 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:28.302123 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0404093e-c61a-42f7-9de5-8ca0cc728165 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:28.303537 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0404093e-c61a-42f7-9de5-8ca0cc728165 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:28.306819 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0404093e-c61a-42f7-9de5-8ca0cc728165 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:28.307960 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0404093e-c61a-42f7-9de5-8ca0cc728165 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:28.403309 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f95f394b-a86a-4cf7-a1aa-3d72d4e92d6e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:28.404020 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f95f394b-a86a-4cf7-a1aa-3d72d4e92d6e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:28.417076 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f95f394b-a86a-4cf7-a1aa-3d72d4e92d6e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:28.417429 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f95f394b-a86a-4cf7-a1aa-3d72d4e92d6e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:28.421669 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f95f394b-a86a-4cf7-a1aa-3d72d4e92d6e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:28.422165 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f95f394b-a86a-4cf7-a1aa-3d72d4e92d6e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:28.431664 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0404093e-c61a-42f7-9de5-8ca0cc728165 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 200 len: 38330 microversion: 2.1 time: 0.163407 Oct 28 08:44:28.433779 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 413/832] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:44:28 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 38330 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:44:28.450666 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c81d430b-db7a-4960-b1a5-42e15e1e22b3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:28.453941 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c81d430b-db7a-4960-b1a5-42e15e1e22b3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:28.464704 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c81d430b-db7a-4960-b1a5-42e15e1e22b3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:28.465433 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c81d430b-db7a-4960-b1a5-42e15e1e22b3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:28.466381 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c81d430b-db7a-4960-b1a5-42e15e1e22b3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:28.467027 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c81d430b-db7a-4960-b1a5-42e15e1e22b3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:28.508826 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c81d430b-db7a-4960-b1a5-42e15e1e22b3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/ips" status: 200 len: 144 microversion: 2.1 time: 0.067358 Oct 28 08:44:28.509421 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 414/833] 10.222.0.76 () {58 vars in 1247 bytes} [Thu Oct 28 08:44:28 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/ips => generated 144 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:44:28.552506 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f95f394b-a86a-4cf7-a1aa-3d72d4e92d6e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 38165 microversion: 2.20 time: 0.154245 Oct 28 08:44:28.553270 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 420/834] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:28 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 38165 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:29.566429 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ae83354b-ee9b-4edf-b612-705563db9a53 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:29.567659 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ae83354b-ee9b-4edf-b612-705563db9a53 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:29.579726 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae83354b-ee9b-4edf-b612-705563db9a53 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:29.598189 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae83354b-ee9b-4edf-b612-705563db9a53 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:29.599130 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae83354b-ee9b-4edf-b612-705563db9a53 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:29.602908 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae83354b-ee9b-4edf-b612-705563db9a53 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:29.739407 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ae83354b-ee9b-4edf-b612-705563db9a53 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 200 len: 38306 microversion: 2.20 time: 0.177564 Oct 28 08:44:29.740146 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 415/835] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:29 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 38306 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:29.769768 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f4b5a164-7f3b-4433-ad34-88e026061e5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:29.773553 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f4b5a164-7f3b-4433-ad34-88e026061e5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:29.811114 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4b5a164-7f3b-4433-ad34-88e026061e5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:29.812988 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4b5a164-7f3b-4433-ad34-88e026061e5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:29.816544 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4b5a164-7f3b-4433-ad34-88e026061e5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:29.817265 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4b5a164-7f3b-4433-ad34-88e026061e5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:29.853693 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f4b5a164-7f3b-4433-ad34-88e026061e5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/ips" status: 200 len: 151 microversion: 2.20 time: 0.100627 Oct 28 08:44:29.855051 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 421/836] 10.222.0.76 () {60 vars in 1288 bytes} [Thu Oct 28 08:44:29 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/ips => generated 151 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:44:31.366366 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b56fbb51-9920-488f-bb66-2e1da10c3eed tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3bd1c6c-6bd5-4311-b8c8-6ea13fb211c3"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:31.367611 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b56fbb51-9920-488f-bb66-2e1da10c3eed tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:31.411156 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b56fbb51-9920-488f-bb66-2e1da10c3eed tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:31.412020 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b56fbb51-9920-488f-bb66-2e1da10c3eed tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:31.413301 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b56fbb51-9920-488f-bb66-2e1da10c3eed tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:31.413855 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b56fbb51-9920-488f-bb66-2e1da10c3eed tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:31.987218 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b56fbb51-9920-488f-bb66-2e1da10c3eed tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.626873 Oct 28 08:44:31.992910 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 416/837] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Oct 28 08:44:31 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/os-volume_attachments => generated 194 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:44:32.466018 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b9763807-52ae-42f1-a99c-89fc7ba60a8a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:32.466831 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b9763807-52ae-42f1-a99c-89fc7ba60a8a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:32.481797 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b9763807-52ae-42f1-a99c-89fc7ba60a8a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:32.490084 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b9763807-52ae-42f1-a99c-89fc7ba60a8a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:32.491052 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b9763807-52ae-42f1-a99c-89fc7ba60a8a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:32.491499 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b9763807-52ae-42f1-a99c-89fc7ba60a8a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:32.541996 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-b9763807-52ae-42f1-a99c-89fc7ba60a8a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lazy-loading 'flavor' on Instance uuid 4e3ca69d-4e09-4205-b6ec-2a6189724e46 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:44:33.021426 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b9763807-52ae-42f1-a99c-89fc7ba60a8a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 202 len: 0 microversion: 2.20 time: 0.560313 Oct 28 08:44:33.026427 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 422/838] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:44:32 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:44:33.038296 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-84e10585-6a0d-468d-b5dc-a89f1540c16a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:33.041527 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-84e10585-6a0d-468d-b5dc-a89f1540c16a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:33.088081 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84e10585-6a0d-468d-b5dc-a89f1540c16a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:33.091893 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84e10585-6a0d-468d-b5dc-a89f1540c16a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:33.093440 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84e10585-6a0d-468d-b5dc-a89f1540c16a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:33.096325 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84e10585-6a0d-468d-b5dc-a89f1540c16a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:33.365213 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-84e10585-6a0d-468d-b5dc-a89f1540c16a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:33.375951 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-84e10585-6a0d-468d-b5dc-a89f1540c16a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:33.377825 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-84e10585-6a0d-468d-b5dc-a89f1540c16a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:33.379656 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-84e10585-6a0d-468d-b5dc-a89f1540c16a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.351003 Oct 28 08:44:33.380725 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 417/839] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:44:33 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:44:33.924678 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-45bc095f-5c77-4066-aaca-16c24766cc67 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Action: 'create', calling method: .version_select at 0x7fed6f13baf0>, body: {"keypair": {"name": "tempest-TestShelveInstance-859765321"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:33.975166 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-45bc095f-5c77-4066-aaca-16c24766cc67 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Getting quotas for project 3b5a1400e6c8401a9ac7192333826fde. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:44:33.993646 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-45bc095f-5c77-4066-aaca-16c24766cc67 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Getting quotas for user f262d208d53949b8a1836c8aa4fc3376 and project 3b5a1400e6c8401a9ac7192333826fde. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:44:34.243318 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-45bc095f-5c77-4066-aaca-16c24766cc67 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Getting quotas for project 3b5a1400e6c8401a9ac7192333826fde. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:44:34.248112 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-45bc095f-5c77-4066-aaca-16c24766cc67 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Getting quotas for user f262d208d53949b8a1836c8aa4fc3376 and project 3b5a1400e6c8401a9ac7192333826fde. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:44:34.266554 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-45bc095f-5c77-4066-aaca-16c24766cc67 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.789612 Oct 28 08:44:34.267835 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 423/840] 10.222.0.76 () {60 vars in 1157 bytes} [Thu Oct 28 08:44:33 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:34.409386 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a8952f9c-0aff-4c1c-a875-54ff18a40500 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:34.410009 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a8952f9c-0aff-4c1c-a875-54ff18a40500 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:34.430892 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a8952f9c-0aff-4c1c-a875-54ff18a40500 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:34.431617 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a8952f9c-0aff-4c1c-a875-54ff18a40500 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:34.432796 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a8952f9c-0aff-4c1c-a875-54ff18a40500 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:34.433425 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a8952f9c-0aff-4c1c-a875-54ff18a40500 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:34.628256 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-a8952f9c-0aff-4c1c-a875-54ff18a40500 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:34.637879 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-a8952f9c-0aff-4c1c-a875-54ff18a40500 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:34.640835 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-a8952f9c-0aff-4c1c-a875-54ff18a40500 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:34.642622 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a8952f9c-0aff-4c1c-a875-54ff18a40500 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.238091 Oct 28 08:44:34.643632 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 418/841] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:44:34 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:44:35.662598 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-09a48c6b-dcaa-4301-a151-18a1d61779ee tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:35.663332 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-09a48c6b-dcaa-4301-a151-18a1d61779ee tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:35.671164 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09a48c6b-dcaa-4301-a151-18a1d61779ee tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:35.671825 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09a48c6b-dcaa-4301-a151-18a1d61779ee tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:35.672616 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09a48c6b-dcaa-4301-a151-18a1d61779ee tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:35.673057 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09a48c6b-dcaa-4301-a151-18a1d61779ee tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:35.833372 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-09a48c6b-dcaa-4301-a151-18a1d61779ee tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:35.848942 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-09a48c6b-dcaa-4301-a151-18a1d61779ee tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:35.851876 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-09a48c6b-dcaa-4301-a151-18a1d61779ee tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:35.854640 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-09a48c6b-dcaa-4301-a151-18a1d61779ee tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.195503 Oct 28 08:44:35.855562 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 424/842] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:44:35 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:44:36.875578 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ab74ede4-ac7a-4220-9462-511f7bae7a66 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:36.876285 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ab74ede4-ac7a-4220-9462-511f7bae7a66 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:36.883505 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab74ede4-ac7a-4220-9462-511f7bae7a66 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:36.884040 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab74ede4-ac7a-4220-9462-511f7bae7a66 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:36.884935 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab74ede4-ac7a-4220-9462-511f7bae7a66 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:36.885472 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab74ede4-ac7a-4220-9462-511f7bae7a66 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:37.018335 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-ab74ede4-ac7a-4220-9462-511f7bae7a66 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:37.026838 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-ab74ede4-ac7a-4220-9462-511f7bae7a66 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:37.028371 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-ab74ede4-ac7a-4220-9462-511f7bae7a66 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:37.029531 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ab74ede4-ac7a-4220-9462-511f7bae7a66 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.158966 Oct 28 08:44:37.030666 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 419/843] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:44:36 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:44:38.053276 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bb98628c-d38e-4d92-b793-0fa3d0cb3b62 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:38.059352 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bb98628c-d38e-4d92-b793-0fa3d0cb3b62 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:38.104972 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb98628c-d38e-4d92-b793-0fa3d0cb3b62 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:38.106157 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb98628c-d38e-4d92-b793-0fa3d0cb3b62 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:38.108676 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb98628c-d38e-4d92-b793-0fa3d0cb3b62 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:38.110157 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb98628c-d38e-4d92-b793-0fa3d0cb3b62 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:38.315917 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-bb98628c-d38e-4d92-b793-0fa3d0cb3b62 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:38.327508 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-bb98628c-d38e-4d92-b793-0fa3d0cb3b62 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:38.329386 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-bb98628c-d38e-4d92-b793-0fa3d0cb3b62 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:38.338643 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bb98628c-d38e-4d92-b793-0fa3d0cb3b62 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.292751 Oct 28 08:44:38.340408 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 425/844] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:44:38 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:44:39.358625 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-29dc7775-be4f-400d-9d1b-6c4ea716ab3d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:39.359275 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-29dc7775-be4f-400d-9d1b-6c4ea716ab3d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:39.365581 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-29dc7775-be4f-400d-9d1b-6c4ea716ab3d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:39.366028 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-29dc7775-be4f-400d-9d1b-6c4ea716ab3d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:39.366823 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-29dc7775-be4f-400d-9d1b-6c4ea716ab3d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:39.367254 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-29dc7775-be4f-400d-9d1b-6c4ea716ab3d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:39.497955 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-29dc7775-be4f-400d-9d1b-6c4ea716ab3d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:39.505844 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-29dc7775-be4f-400d-9d1b-6c4ea716ab3d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:39.507369 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-29dc7775-be4f-400d-9d1b-6c4ea716ab3d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:39.508518 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-29dc7775-be4f-400d-9d1b-6c4ea716ab3d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.154376 Oct 28 08:44:39.509100 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 420/845] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:44:39 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:44:40.527033 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-229c28b0-3eae-4aa3-a269-813513fcd317 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:40.527569 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-229c28b0-3eae-4aa3-a269-813513fcd317 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:40.534144 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-229c28b0-3eae-4aa3-a269-813513fcd317 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:40.534628 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-229c28b0-3eae-4aa3-a269-813513fcd317 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:40.535403 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-229c28b0-3eae-4aa3-a269-813513fcd317 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:40.535831 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-229c28b0-3eae-4aa3-a269-813513fcd317 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:40.678031 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-229c28b0-3eae-4aa3-a269-813513fcd317 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:40.687560 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-229c28b0-3eae-4aa3-a269-813513fcd317 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:40.689281 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-229c28b0-3eae-4aa3-a269-813513fcd317 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:40.690485 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-229c28b0-3eae-4aa3-a269-813513fcd317 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.167215 Oct 28 08:44:40.691431 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 426/846] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:44:40 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:44:40.762420 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-78163f2c-48ff-4f18-975c-4fad916cec33 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:44:40.773105 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78163f2c-48ff-4f18-975c-4fad916cec33 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:40.773590 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78163f2c-48ff-4f18-975c-4fad916cec33 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:40.857342 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-78163f2c-48ff-4f18-975c-4fad916cec33 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Going to try to stop instance {{(pid=122256) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 28 08:44:40.919915 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-78163f2c-48ff-4f18-975c-4fad916cec33 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 202 len: 0 microversion: 2.1 time: 0.160888 Oct 28 08:44:40.922170 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 421/847] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:44:40 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:44:40.930394 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1208ac1d-ab8b-4622-90cc-d4a7e32b34c5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:40.931033 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1208ac1d-ab8b-4622-90cc-d4a7e32b34c5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:40.968338 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1208ac1d-ab8b-4622-90cc-d4a7e32b34c5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:40.968786 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1208ac1d-ab8b-4622-90cc-d4a7e32b34c5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:40.969612 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1208ac1d-ab8b-4622-90cc-d4a7e32b34c5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:40.970367 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1208ac1d-ab8b-4622-90cc-d4a7e32b34c5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:41.143545 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1208ac1d-ab8b-4622-90cc-d4a7e32b34c5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:41.151757 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1208ac1d-ab8b-4622-90cc-d4a7e32b34c5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1722 microversion: 2.1 time: 0.225416 Oct 28 08:44:41.152336 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 427/848] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:40 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:41.709947 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d90e5e7c-ec6e-4f79-ad89-3df0988895ad tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:41.710574 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d90e5e7c-ec6e-4f79-ad89-3df0988895ad tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:41.716819 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d90e5e7c-ec6e-4f79-ad89-3df0988895ad tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:41.717301 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d90e5e7c-ec6e-4f79-ad89-3df0988895ad tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:41.718086 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d90e5e7c-ec6e-4f79-ad89-3df0988895ad tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:41.718534 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d90e5e7c-ec6e-4f79-ad89-3df0988895ad tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:41.847029 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-d90e5e7c-ec6e-4f79-ad89-3df0988895ad tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:41.858582 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-d90e5e7c-ec6e-4f79-ad89-3df0988895ad tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:41.861580 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-d90e5e7c-ec6e-4f79-ad89-3df0988895ad tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:41.863517 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d90e5e7c-ec6e-4f79-ad89-3df0988895ad tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.157547 Oct 28 08:44:41.864382 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 422/849] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:44:41 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:44:42.169240 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-26284231-3609-4809-91d3-9189ce400d56 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:42.169858 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-26284231-3609-4809-91d3-9189ce400d56 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:42.176762 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26284231-3609-4809-91d3-9189ce400d56 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:42.177197 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26284231-3609-4809-91d3-9189ce400d56 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:42.177951 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26284231-3609-4809-91d3-9189ce400d56 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:42.178367 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26284231-3609-4809-91d3-9189ce400d56 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:42.324125 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-26284231-3609-4809-91d3-9189ce400d56 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:42.333181 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-26284231-3609-4809-91d3-9189ce400d56 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1722 microversion: 2.1 time: 0.167502 Oct 28 08:44:42.333761 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 428/850] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:42 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:42.882630 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fdfd0d54-6a93-4142-a489-f95bac598972 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:42.883233 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fdfd0d54-6a93-4142-a489-f95bac598972 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:42.889468 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdfd0d54-6a93-4142-a489-f95bac598972 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:42.889911 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdfd0d54-6a93-4142-a489-f95bac598972 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:42.890708 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdfd0d54-6a93-4142-a489-f95bac598972 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:42.891136 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdfd0d54-6a93-4142-a489-f95bac598972 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:43.016626 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-fdfd0d54-6a93-4142-a489-f95bac598972 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:43.024536 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-fdfd0d54-6a93-4142-a489-f95bac598972 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:43.026020 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-fdfd0d54-6a93-4142-a489-f95bac598972 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:43.027272 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fdfd0d54-6a93-4142-a489-f95bac598972 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.148457 Oct 28 08:44:43.027821 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 423/851] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:44:42 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:44:43.351553 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b871bd7e-c71a-420e-9489-a0485afae7ea tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:43.352162 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b871bd7e-c71a-420e-9489-a0485afae7ea tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:43.358364 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b871bd7e-c71a-420e-9489-a0485afae7ea tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:43.358845 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b871bd7e-c71a-420e-9489-a0485afae7ea tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:43.359782 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b871bd7e-c71a-420e-9489-a0485afae7ea tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:43.360228 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b871bd7e-c71a-420e-9489-a0485afae7ea tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:43.486581 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-b871bd7e-c71a-420e-9489-a0485afae7ea tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:43.494394 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b871bd7e-c71a-420e-9489-a0485afae7ea tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1722 microversion: 2.1 time: 0.146468 Oct 28 08:44:43.494988 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 429/852] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:43 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:44.047144 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c4ebb92e-83fa-4495-a1fa-25740b3a296a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:44.047746 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c4ebb92e-83fa-4495-a1fa-25740b3a296a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:44.054048 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4ebb92e-83fa-4495-a1fa-25740b3a296a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:44.054516 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4ebb92e-83fa-4495-a1fa-25740b3a296a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:44.055313 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4ebb92e-83fa-4495-a1fa-25740b3a296a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:44.055750 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4ebb92e-83fa-4495-a1fa-25740b3a296a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:44.186372 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c4ebb92e-83fa-4495-a1fa-25740b3a296a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:44.196725 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c4ebb92e-83fa-4495-a1fa-25740b3a296a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:44.198241 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c4ebb92e-83fa-4495-a1fa-25740b3a296a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:44.199474 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c4ebb92e-83fa-4495-a1fa-25740b3a296a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.157093 Oct 28 08:44:44.200031 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 424/853] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:44:44 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:44:44.512699 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ad6cd390-c31d-4a82-94e5-103b683e8df2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:44.513298 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ad6cd390-c31d-4a82-94e5-103b683e8df2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:44.520213 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad6cd390-c31d-4a82-94e5-103b683e8df2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:44.520648 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad6cd390-c31d-4a82-94e5-103b683e8df2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:44.521405 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad6cd390-c31d-4a82-94e5-103b683e8df2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:44.521823 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad6cd390-c31d-4a82-94e5-103b683e8df2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:44.652389 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-ad6cd390-c31d-4a82-94e5-103b683e8df2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:44.661575 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ad6cd390-c31d-4a82-94e5-103b683e8df2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1722 microversion: 2.1 time: 0.152637 Oct 28 08:44:44.662144 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 430/854] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:44 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:45.223678 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7d07f7d7-9ab5-4ff9-999d-32ba2c59e901 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:45.224440 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7d07f7d7-9ab5-4ff9-999d-32ba2c59e901 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:45.231961 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d07f7d7-9ab5-4ff9-999d-32ba2c59e901 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:45.232562 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d07f7d7-9ab5-4ff9-999d-32ba2c59e901 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:45.233590 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d07f7d7-9ab5-4ff9-999d-32ba2c59e901 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:45.234264 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d07f7d7-9ab5-4ff9-999d-32ba2c59e901 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:45.369035 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-7d07f7d7-9ab5-4ff9-999d-32ba2c59e901 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:45.377479 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-7d07f7d7-9ab5-4ff9-999d-32ba2c59e901 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:45.379002 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-7d07f7d7-9ab5-4ff9-999d-32ba2c59e901 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:45.380163 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7d07f7d7-9ab5-4ff9-999d-32ba2c59e901 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.161479 Oct 28 08:44:45.380712 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 425/855] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:44:45 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:44:45.680140 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b36faf22-131d-49a0-b4e3-0e6ba7b0bcd0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:45.680708 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b36faf22-131d-49a0-b4e3-0e6ba7b0bcd0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:45.689605 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b36faf22-131d-49a0-b4e3-0e6ba7b0bcd0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:45.689605 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b36faf22-131d-49a0-b4e3-0e6ba7b0bcd0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:45.690950 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b36faf22-131d-49a0-b4e3-0e6ba7b0bcd0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:45.691514 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b36faf22-131d-49a0-b4e3-0e6ba7b0bcd0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:45.834261 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-b36faf22-131d-49a0-b4e3-0e6ba7b0bcd0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:45.843482 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b36faf22-131d-49a0-b4e3-0e6ba7b0bcd0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1722 microversion: 2.1 time: 0.166990 Oct 28 08:44:45.844082 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 431/856] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:45 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:46.399262 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d9a6a142-68c2-4469-9bb5-8de7c21bc27f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:46.399955 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d9a6a142-68c2-4469-9bb5-8de7c21bc27f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:46.407377 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d9a6a142-68c2-4469-9bb5-8de7c21bc27f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:46.407821 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d9a6a142-68c2-4469-9bb5-8de7c21bc27f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:46.409439 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d9a6a142-68c2-4469-9bb5-8de7c21bc27f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:46.410107 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d9a6a142-68c2-4469-9bb5-8de7c21bc27f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:46.760009 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-d9a6a142-68c2-4469-9bb5-8de7c21bc27f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:46.768402 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-d9a6a142-68c2-4469-9bb5-8de7c21bc27f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:46.769913 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-d9a6a142-68c2-4469-9bb5-8de7c21bc27f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:46.771112 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d9a6a142-68c2-4469-9bb5-8de7c21bc27f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.375661 Oct 28 08:44:46.771677 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 426/857] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:44:46 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:44:46.863748 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0824fbb8-954d-4240-950a-48ebb0a16e4e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:46.864347 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0824fbb8-954d-4240-950a-48ebb0a16e4e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:46.871282 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0824fbb8-954d-4240-950a-48ebb0a16e4e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:46.871736 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0824fbb8-954d-4240-950a-48ebb0a16e4e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:46.872512 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0824fbb8-954d-4240-950a-48ebb0a16e4e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:46.873050 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0824fbb8-954d-4240-950a-48ebb0a16e4e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:47.006381 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-0824fbb8-954d-4240-950a-48ebb0a16e4e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:47.015369 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0824fbb8-954d-4240-950a-48ebb0a16e4e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1722 microversion: 2.1 time: 0.155079 Oct 28 08:44:47.015792 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 432/858] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:46 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:47.789751 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-099b3190-f91b-49a8-a8af-9260e73e8eb6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:47.790365 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-099b3190-f91b-49a8-a8af-9260e73e8eb6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:47.797299 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-099b3190-f91b-49a8-a8af-9260e73e8eb6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:47.797745 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-099b3190-f91b-49a8-a8af-9260e73e8eb6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:47.798538 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-099b3190-f91b-49a8-a8af-9260e73e8eb6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:47.798978 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-099b3190-f91b-49a8-a8af-9260e73e8eb6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:47.930606 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-099b3190-f91b-49a8-a8af-9260e73e8eb6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:47.939627 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-099b3190-f91b-49a8-a8af-9260e73e8eb6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:47.941129 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-099b3190-f91b-49a8-a8af-9260e73e8eb6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:47.942299 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-099b3190-f91b-49a8-a8af-9260e73e8eb6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.156237 Oct 28 08:44:47.942889 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 427/859] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:44:47 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:44:48.032039 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-54f84973-e2a4-4d60-bb45-1d0fa6645196 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:48.032680 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-54f84973-e2a4-4d60-bb45-1d0fa6645196 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:48.039067 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54f84973-e2a4-4d60-bb45-1d0fa6645196 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:48.039512 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54f84973-e2a4-4d60-bb45-1d0fa6645196 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:48.040288 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54f84973-e2a4-4d60-bb45-1d0fa6645196 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:48.040720 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54f84973-e2a4-4d60-bb45-1d0fa6645196 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:48.174051 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-54f84973-e2a4-4d60-bb45-1d0fa6645196 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:48.182076 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-54f84973-e2a4-4d60-bb45-1d0fa6645196 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1722 microversion: 2.1 time: 0.154181 Oct 28 08:44:48.182681 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 433/860] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:48 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:48.962011 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5c20f60e-7fa7-4270-8fd3-3954c9638dc8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:48.963340 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5c20f60e-7fa7-4270-8fd3-3954c9638dc8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:48.969867 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c20f60e-7fa7-4270-8fd3-3954c9638dc8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:48.970609 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c20f60e-7fa7-4270-8fd3-3954c9638dc8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:48.971568 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c20f60e-7fa7-4270-8fd3-3954c9638dc8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:48.972154 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c20f60e-7fa7-4270-8fd3-3954c9638dc8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:49.102569 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-5c20f60e-7fa7-4270-8fd3-3954c9638dc8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:49.111342 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-5c20f60e-7fa7-4270-8fd3-3954c9638dc8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:49.112811 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-5c20f60e-7fa7-4270-8fd3-3954c9638dc8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:49.113957 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5c20f60e-7fa7-4270-8fd3-3954c9638dc8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.156278 Oct 28 08:44:49.114537 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 428/861] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:44:48 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:44:49.199552 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c2118a08-3be7-49e1-8a16-a0158716249a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:49.200135 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c2118a08-3be7-49e1-8a16-a0158716249a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:49.208116 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2118a08-3be7-49e1-8a16-a0158716249a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:49.208553 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2118a08-3be7-49e1-8a16-a0158716249a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:49.209325 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2118a08-3be7-49e1-8a16-a0158716249a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:49.209744 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2118a08-3be7-49e1-8a16-a0158716249a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:49.350695 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-c2118a08-3be7-49e1-8a16-a0158716249a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:49.360367 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c2118a08-3be7-49e1-8a16-a0158716249a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1722 microversion: 2.1 time: 0.164473 Oct 28 08:44:49.361753 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 434/862] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:49 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:44:50.133281 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7b999be7-05dd-4d3c-9ab4-6a3a8a59c30b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:50.134036 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7b999be7-05dd-4d3c-9ab4-6a3a8a59c30b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:50.141051 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b999be7-05dd-4d3c-9ab4-6a3a8a59c30b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:50.141501 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b999be7-05dd-4d3c-9ab4-6a3a8a59c30b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:50.142279 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b999be7-05dd-4d3c-9ab4-6a3a8a59c30b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:50.142744 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b999be7-05dd-4d3c-9ab4-6a3a8a59c30b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:50.274888 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-7b999be7-05dd-4d3c-9ab4-6a3a8a59c30b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:50.284334 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-7b999be7-05dd-4d3c-9ab4-6a3a8a59c30b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:50.285809 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-7b999be7-05dd-4d3c-9ab4-6a3a8a59c30b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:50.286998 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7b999be7-05dd-4d3c-9ab4-6a3a8a59c30b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.157474 Oct 28 08:44:50.287552 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 429/863] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:44:50 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:44:50.378031 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d6ccec9d-5460-42f7-b5a4-fd1095cefd5e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:50.378623 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d6ccec9d-5460-42f7-b5a4-fd1095cefd5e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:50.385187 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6ccec9d-5460-42f7-b5a4-fd1095cefd5e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:50.385634 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6ccec9d-5460-42f7-b5a4-fd1095cefd5e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:50.386434 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6ccec9d-5460-42f7-b5a4-fd1095cefd5e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:50.386962 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6ccec9d-5460-42f7-b5a4-fd1095cefd5e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:50.515732 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-d6ccec9d-5460-42f7-b5a4-fd1095cefd5e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:50.525165 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d6ccec9d-5460-42f7-b5a4-fd1095cefd5e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1722 microversion: 2.1 time: 0.151035 Oct 28 08:44:50.525769 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 435/864] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:50 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:51.305124 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3550d9a0-c309-41f2-908e-f48aaf816e99 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:51.305759 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3550d9a0-c309-41f2-908e-f48aaf816e99 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:51.312778 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3550d9a0-c309-41f2-908e-f48aaf816e99 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:51.313218 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3550d9a0-c309-41f2-908e-f48aaf816e99 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:51.313997 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3550d9a0-c309-41f2-908e-f48aaf816e99 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:51.314421 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3550d9a0-c309-41f2-908e-f48aaf816e99 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:51.441611 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-3550d9a0-c309-41f2-908e-f48aaf816e99 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:51.450311 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-3550d9a0-c309-41f2-908e-f48aaf816e99 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:51.452237 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-3550d9a0-c309-41f2-908e-f48aaf816e99 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:51.453431 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3550d9a0-c309-41f2-908e-f48aaf816e99 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.152068 Oct 28 08:44:51.454200 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 430/865] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:44:51 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:44:51.544656 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c77c07de-ec43-4cb3-aee7-2015fdac2b31 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:51.546067 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c77c07de-ec43-4cb3-aee7-2015fdac2b31 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:51.552036 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c77c07de-ec43-4cb3-aee7-2015fdac2b31 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:51.552587 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c77c07de-ec43-4cb3-aee7-2015fdac2b31 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:51.553362 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c77c07de-ec43-4cb3-aee7-2015fdac2b31 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:51.553795 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c77c07de-ec43-4cb3-aee7-2015fdac2b31 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:51.690350 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-c77c07de-ec43-4cb3-aee7-2015fdac2b31 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:51.698892 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c77c07de-ec43-4cb3-aee7-2015fdac2b31 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1722 microversion: 2.1 time: 0.158217 Oct 28 08:44:51.699471 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 436/866] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:51 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:52.473233 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-73b751f9-b7dd-42e8-9814-883be2fe0225 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:52.473991 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-73b751f9-b7dd-42e8-9814-883be2fe0225 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:52.480977 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73b751f9-b7dd-42e8-9814-883be2fe0225 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:52.481428 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73b751f9-b7dd-42e8-9814-883be2fe0225 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:52.482812 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73b751f9-b7dd-42e8-9814-883be2fe0225 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:52.483357 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73b751f9-b7dd-42e8-9814-883be2fe0225 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:52.718995 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c2e57f5c-9c10-431f-b74a-bdf9f767f6d4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:52.719981 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c2e57f5c-9c10-431f-b74a-bdf9f767f6d4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:52.727054 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2e57f5c-9c10-431f-b74a-bdf9f767f6d4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:52.727808 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2e57f5c-9c10-431f-b74a-bdf9f767f6d4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:52.728825 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2e57f5c-9c10-431f-b74a-bdf9f767f6d4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:52.729255 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2e57f5c-9c10-431f-b74a-bdf9f767f6d4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:52.772341 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-73b751f9-b7dd-42e8-9814-883be2fe0225 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:52.781479 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-73b751f9-b7dd-42e8-9814-883be2fe0225 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:52.783037 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-73b751f9-b7dd-42e8-9814-883be2fe0225 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:52.784232 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-73b751f9-b7dd-42e8-9814-883be2fe0225 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.315432 Oct 28 08:44:52.784804 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 431/867] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:44:52 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:44:52.999881 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-c2e57f5c-9c10-431f-b74a-bdf9f767f6d4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:53.008193 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c2e57f5c-9c10-431f-b74a-bdf9f767f6d4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1722 microversion: 2.1 time: 0.294220 Oct 28 08:44:53.008742 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 437/868] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:52 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1722 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:53.805558 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ffe9ec02-43e7-4f78-b6f9-2b534576a7a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:53.806152 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ffe9ec02-43e7-4f78-b6f9-2b534576a7a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:53.813163 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ffe9ec02-43e7-4f78-b6f9-2b534576a7a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:53.813601 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ffe9ec02-43e7-4f78-b6f9-2b534576a7a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:53.814702 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ffe9ec02-43e7-4f78-b6f9-2b534576a7a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:53.815162 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ffe9ec02-43e7-4f78-b6f9-2b534576a7a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:53.974075 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-ffe9ec02-43e7-4f78-b6f9-2b534576a7a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:53.981932 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-ffe9ec02-43e7-4f78-b6f9-2b534576a7a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:53.983516 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-ffe9ec02-43e7-4f78-b6f9-2b534576a7a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:53.984750 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ffe9ec02-43e7-4f78-b6f9-2b534576a7a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.182848 Oct 28 08:44:53.985314 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 432/869] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:44:53 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:44:54.026060 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6256f9b1-070b-4913-9d9f-8f86cbbddc3e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:54.027433 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6256f9b1-070b-4913-9d9f-8f86cbbddc3e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:54.035410 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6256f9b1-070b-4913-9d9f-8f86cbbddc3e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:54.036339 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6256f9b1-070b-4913-9d9f-8f86cbbddc3e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:54.037703 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6256f9b1-070b-4913-9d9f-8f86cbbddc3e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:54.038144 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6256f9b1-070b-4913-9d9f-8f86cbbddc3e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:54.192353 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-6256f9b1-070b-4913-9d9f-8f86cbbddc3e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:54.198811 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 08:44:54.199111 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: Thu Oct 28 08:44:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 (ip 10.222.0.76) !!! Oct 28 08:44:54.211860 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6256f9b1-070b-4913-9d9f-8f86cbbddc3e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1722 microversion: 2.1 time: 0.189436 Oct 28 08:44:54.220394 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 438/870] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:54 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:44:55.004756 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d2133551-f6cc-48e5-a8b9-51fc51e0104c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:55.005555 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d2133551-f6cc-48e5-a8b9-51fc51e0104c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:55.012911 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2133551-f6cc-48e5-a8b9-51fc51e0104c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:55.014134 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2133551-f6cc-48e5-a8b9-51fc51e0104c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:55.015041 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2133551-f6cc-48e5-a8b9-51fc51e0104c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:55.015500 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2133551-f6cc-48e5-a8b9-51fc51e0104c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:55.155650 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-d2133551-f6cc-48e5-a8b9-51fc51e0104c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:55.164300 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-d2133551-f6cc-48e5-a8b9-51fc51e0104c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:55.165785 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-d2133551-f6cc-48e5-a8b9-51fc51e0104c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:55.166990 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d2133551-f6cc-48e5-a8b9-51fc51e0104c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.166048 Oct 28 08:44:55.168928 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 433/871] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:44:54 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:44:55.231108 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6c3c5c38-c59a-4fa5-b5ce-b215ecd58b30 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:55.232186 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6c3c5c38-c59a-4fa5-b5ce-b215ecd58b30 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:55.239530 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c3c5c38-c59a-4fa5-b5ce-b215ecd58b30 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:55.240101 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c3c5c38-c59a-4fa5-b5ce-b215ecd58b30 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:55.241028 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c3c5c38-c59a-4fa5-b5ce-b215ecd58b30 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:55.241460 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c3c5c38-c59a-4fa5-b5ce-b215ecd58b30 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:55.389819 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-6c3c5c38-c59a-4fa5-b5ce-b215ecd58b30 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:55.397991 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6c3c5c38-c59a-4fa5-b5ce-b215ecd58b30 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1722 microversion: 2.1 time: 0.171815 Oct 28 08:44:55.398585 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 439/872] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:55 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:56.185113 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f1c5538f-2575-4072-a175-e58f85a5548a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:56.186998 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f1c5538f-2575-4072-a175-e58f85a5548a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:56.192755 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1c5538f-2575-4072-a175-e58f85a5548a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:56.193300 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1c5538f-2575-4072-a175-e58f85a5548a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:56.193968 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1c5538f-2575-4072-a175-e58f85a5548a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:56.194701 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1c5538f-2575-4072-a175-e58f85a5548a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:56.325217 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-f1c5538f-2575-4072-a175-e58f85a5548a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:56.334317 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-f1c5538f-2575-4072-a175-e58f85a5548a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:56.335882 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-f1c5538f-2575-4072-a175-e58f85a5548a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:56.337034 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f1c5538f-2575-4072-a175-e58f85a5548a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.155651 Oct 28 08:44:56.337625 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 434/873] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:44:56 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:44:56.415869 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8976943f-d33b-40f2-9ac6-508daf782c70 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:56.416396 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8976943f-d33b-40f2-9ac6-508daf782c70 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:56.423598 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8976943f-d33b-40f2-9ac6-508daf782c70 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:56.424042 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8976943f-d33b-40f2-9ac6-508daf782c70 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:56.424837 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8976943f-d33b-40f2-9ac6-508daf782c70 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:56.425249 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8976943f-d33b-40f2-9ac6-508daf782c70 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:56.554037 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-8976943f-d33b-40f2-9ac6-508daf782c70 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:56.562153 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8976943f-d33b-40f2-9ac6-508daf782c70 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1722 microversion: 2.1 time: 0.149973 Oct 28 08:44:56.562762 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 440/874] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:56 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:57.361219 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ac5f651e-2ff6-46bd-ba3f-ad6cb80496cf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:57.361965 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ac5f651e-2ff6-46bd-ba3f-ad6cb80496cf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:57.368071 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac5f651e-2ff6-46bd-ba3f-ad6cb80496cf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:57.368517 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac5f651e-2ff6-46bd-ba3f-ad6cb80496cf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:57.369309 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac5f651e-2ff6-46bd-ba3f-ad6cb80496cf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:57.369745 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac5f651e-2ff6-46bd-ba3f-ad6cb80496cf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:57.507932 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-ac5f651e-2ff6-46bd-ba3f-ad6cb80496cf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:57.517725 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-ac5f651e-2ff6-46bd-ba3f-ad6cb80496cf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:57.519271 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-ac5f651e-2ff6-46bd-ba3f-ad6cb80496cf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:57.520446 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ac5f651e-2ff6-46bd-ba3f-ad6cb80496cf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.168057 Oct 28 08:44:57.521007 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 435/875] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:44:57 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:44:57.579567 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-34f6fd64-abba-4e1c-b1ca-efc358eaa997 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:57.580500 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-34f6fd64-abba-4e1c-b1ca-efc358eaa997 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:57.587078 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34f6fd64-abba-4e1c-b1ca-efc358eaa997 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:57.587517 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34f6fd64-abba-4e1c-b1ca-efc358eaa997 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:57.588294 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34f6fd64-abba-4e1c-b1ca-efc358eaa997 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:57.588729 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34f6fd64-abba-4e1c-b1ca-efc358eaa997 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:57.723461 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-34f6fd64-abba-4e1c-b1ca-efc358eaa997 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:57.731577 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-34f6fd64-abba-4e1c-b1ca-efc358eaa997 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1722 microversion: 2.1 time: 0.156565 Oct 28 08:44:57.732668 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 441/876] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:57 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:44:58.538965 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fd38bf49-4e5a-4155-9d0d-3b34270ed66a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:58.539561 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fd38bf49-4e5a-4155-9d0d-3b34270ed66a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:58.546055 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd38bf49-4e5a-4155-9d0d-3b34270ed66a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:58.546519 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd38bf49-4e5a-4155-9d0d-3b34270ed66a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:58.547294 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd38bf49-4e5a-4155-9d0d-3b34270ed66a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:58.547726 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd38bf49-4e5a-4155-9d0d-3b34270ed66a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:58.681345 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-fd38bf49-4e5a-4155-9d0d-3b34270ed66a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:58.690786 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-fd38bf49-4e5a-4155-9d0d-3b34270ed66a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:58.692273 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-fd38bf49-4e5a-4155-9d0d-3b34270ed66a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:58.693427 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fd38bf49-4e5a-4155-9d0d-3b34270ed66a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.158269 Oct 28 08:44:58.693982 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 436/877] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:44:58 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:44:58.753062 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b0c71455-3c5d-4715-89fb-5b859980a1cd tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:58.754181 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b0c71455-3c5d-4715-89fb-5b859980a1cd tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:58.763191 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0c71455-3c5d-4715-89fb-5b859980a1cd tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:58.764817 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0c71455-3c5d-4715-89fb-5b859980a1cd tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:58.765624 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0c71455-3c5d-4715-89fb-5b859980a1cd tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:58.766047 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0c71455-3c5d-4715-89fb-5b859980a1cd tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:58.905244 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-b0c71455-3c5d-4715-89fb-5b859980a1cd tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:58.916032 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b0c71455-3c5d-4715-89fb-5b859980a1cd tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1722 microversion: 2.1 time: 0.169743 Oct 28 08:44:58.917055 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 442/878] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:58 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:44:59.717225 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-94af0f6d-7222-4f9c-a33f-d8e0b647ceaa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:59.717830 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-94af0f6d-7222-4f9c-a33f-d8e0b647ceaa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:59.724482 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94af0f6d-7222-4f9c-a33f-d8e0b647ceaa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:59.724927 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94af0f6d-7222-4f9c-a33f-d8e0b647ceaa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:59.725705 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94af0f6d-7222-4f9c-a33f-d8e0b647ceaa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:59.726140 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94af0f6d-7222-4f9c-a33f-d8e0b647ceaa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:59.866584 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-94af0f6d-7222-4f9c-a33f-d8e0b647ceaa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:59.875386 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-94af0f6d-7222-4f9c-a33f-d8e0b647ceaa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:59.876923 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-94af0f6d-7222-4f9c-a33f-d8e0b647ceaa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:44:59.878080 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-94af0f6d-7222-4f9c-a33f-d8e0b647ceaa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.164564 Oct 28 08:44:59.878668 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 437/879] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:44:59 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:44:59.937897 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bcee1c70-d8da-4ab0-820a-c9e48120233d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:44:59.938593 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bcee1c70-d8da-4ab0-820a-c9e48120233d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:44:59.945033 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcee1c70-d8da-4ab0-820a-c9e48120233d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:59.945474 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcee1c70-d8da-4ab0-820a-c9e48120233d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:44:59.946255 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcee1c70-d8da-4ab0-820a-c9e48120233d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:44:59.946716 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcee1c70-d8da-4ab0-820a-c9e48120233d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:00.073557 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-bcee1c70-d8da-4ab0-820a-c9e48120233d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:00.082960 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bcee1c70-d8da-4ab0-820a-c9e48120233d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1722 microversion: 2.1 time: 0.149462 Oct 28 08:45:00.083553 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 443/880] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:44:59 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:00.897322 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2fc837ff-7458-4871-9cc0-270929d14ac7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:00.898072 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2fc837ff-7458-4871-9cc0-270929d14ac7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:00.906185 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2fc837ff-7458-4871-9cc0-270929d14ac7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:00.906671 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2fc837ff-7458-4871-9cc0-270929d14ac7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:00.907496 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2fc837ff-7458-4871-9cc0-270929d14ac7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:00.908429 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2fc837ff-7458-4871-9cc0-270929d14ac7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:01.042998 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-2fc837ff-7458-4871-9cc0-270929d14ac7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:01.051212 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-2fc837ff-7458-4871-9cc0-270929d14ac7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:01.052699 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-2fc837ff-7458-4871-9cc0-270929d14ac7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:01.053864 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2fc837ff-7458-4871-9cc0-270929d14ac7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.161280 Oct 28 08:45:01.054428 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 438/881] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:00 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:45:01.100671 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9468c658-ca52-4581-bbec-26d176605c29 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:01.101270 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9468c658-ca52-4581-bbec-26d176605c29 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:01.108367 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9468c658-ca52-4581-bbec-26d176605c29 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:01.108842 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9468c658-ca52-4581-bbec-26d176605c29 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:01.109622 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9468c658-ca52-4581-bbec-26d176605c29 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:01.110056 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9468c658-ca52-4581-bbec-26d176605c29 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:01.244179 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-9468c658-ca52-4581-bbec-26d176605c29 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:01.256097 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9468c658-ca52-4581-bbec-26d176605c29 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1722 microversion: 2.1 time: 0.158815 Oct 28 08:45:01.256770 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 444/882] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:01 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:02.073439 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4ec079d2-86dd-423b-89ca-774ba54fe182 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:02.074046 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4ec079d2-86dd-423b-89ca-774ba54fe182 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:02.081482 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ec079d2-86dd-423b-89ca-774ba54fe182 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:02.081935 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ec079d2-86dd-423b-89ca-774ba54fe182 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:02.082756 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ec079d2-86dd-423b-89ca-774ba54fe182 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:02.083189 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ec079d2-86dd-423b-89ca-774ba54fe182 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:02.274308 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8abe8775-ffd9-49ef-9f2f-eed9a7296026 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:02.275055 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8abe8775-ffd9-49ef-9f2f-eed9a7296026 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:02.282560 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8abe8775-ffd9-49ef-9f2f-eed9a7296026 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:02.283039 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8abe8775-ffd9-49ef-9f2f-eed9a7296026 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:02.283851 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8abe8775-ffd9-49ef-9f2f-eed9a7296026 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:02.284508 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8abe8775-ffd9-49ef-9f2f-eed9a7296026 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:02.293693 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-4ec079d2-86dd-423b-89ca-774ba54fe182 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:02.303440 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-4ec079d2-86dd-423b-89ca-774ba54fe182 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:02.305344 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-4ec079d2-86dd-423b-89ca-774ba54fe182 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:02.306966 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4ec079d2-86dd-423b-89ca-774ba54fe182 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.237087 Oct 28 08:45:02.307775 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 439/883] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:02 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:02.488318 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-8abe8775-ffd9-49ef-9f2f-eed9a7296026 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:02.502129 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8abe8775-ffd9-49ef-9f2f-eed9a7296026 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1722 microversion: 2.1 time: 0.231325 Oct 28 08:45:02.502743 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 445/884] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:02 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:45:03.330413 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1b2025a7-59de-4d01-b89c-3e529a366c28 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:03.331051 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1b2025a7-59de-4d01-b89c-3e529a366c28 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:03.337275 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b2025a7-59de-4d01-b89c-3e529a366c28 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:03.337715 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b2025a7-59de-4d01-b89c-3e529a366c28 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:03.338480 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b2025a7-59de-4d01-b89c-3e529a366c28 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:03.338929 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b2025a7-59de-4d01-b89c-3e529a366c28 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:03.469650 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-1b2025a7-59de-4d01-b89c-3e529a366c28 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:03.477582 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-1b2025a7-59de-4d01-b89c-3e529a366c28 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:03.478977 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-1b2025a7-59de-4d01-b89c-3e529a366c28 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:03.480140 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1b2025a7-59de-4d01-b89c-3e529a366c28 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.153469 Oct 28 08:45:03.480708 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 440/885] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:03 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:03.629675 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b46a7e05-e9cb-4afc-a535-477c47ae1375 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:03.630363 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b46a7e05-e9cb-4afc-a535-477c47ae1375 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:03.636243 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b46a7e05-e9cb-4afc-a535-477c47ae1375 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:03.636691 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b46a7e05-e9cb-4afc-a535-477c47ae1375 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:03.637456 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b46a7e05-e9cb-4afc-a535-477c47ae1375 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:03.637883 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b46a7e05-e9cb-4afc-a535-477c47ae1375 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:03.772726 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-b46a7e05-e9cb-4afc-a535-477c47ae1375 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:03.781528 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b46a7e05-e9cb-4afc-a535-477c47ae1375 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1722 microversion: 2.1 time: 0.265653 Oct 28 08:45:03.786679 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 446/886] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:03 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:04.499857 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5ee68c01-f350-4a43-a96c-3958e2d3c974 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:04.500468 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5ee68c01-f350-4a43-a96c-3958e2d3c974 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:04.507065 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ee68c01-f350-4a43-a96c-3958e2d3c974 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:04.507707 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ee68c01-f350-4a43-a96c-3958e2d3c974 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:04.508621 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ee68c01-f350-4a43-a96c-3958e2d3c974 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:04.509078 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ee68c01-f350-4a43-a96c-3958e2d3c974 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:04.639104 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-5ee68c01-f350-4a43-a96c-3958e2d3c974 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:04.647137 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-5ee68c01-f350-4a43-a96c-3958e2d3c974 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:04.648627 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-5ee68c01-f350-4a43-a96c-3958e2d3c974 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:04.649780 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5ee68c01-f350-4a43-a96c-3958e2d3c974 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1743 microversion: 2.20 time: 0.154309 Oct 28 08:45:04.650341 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 441/887] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:04 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:04.798590 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7479f057-cebe-4949-8cb5-909ef5827cf2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:04.799157 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7479f057-cebe-4949-8cb5-909ef5827cf2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:04.805488 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7479f057-cebe-4949-8cb5-909ef5827cf2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:04.805941 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7479f057-cebe-4949-8cb5-909ef5827cf2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:04.806778 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7479f057-cebe-4949-8cb5-909ef5827cf2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:04.807210 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7479f057-cebe-4949-8cb5-909ef5827cf2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:04.945781 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-7479f057-cebe-4949-8cb5-909ef5827cf2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:04.956644 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7479f057-cebe-4949-8cb5-909ef5827cf2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1722 microversion: 2.1 time: 0.161633 Oct 28 08:45:04.957542 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 447/888] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:04 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:05.772129 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5956a931-196a-4f29-bee1-ba2f07a02f73 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:05.772851 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5956a931-196a-4f29-bee1-ba2f07a02f73 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:05.780043 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5956a931-196a-4f29-bee1-ba2f07a02f73 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:05.780505 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5956a931-196a-4f29-bee1-ba2f07a02f73 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:05.781272 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5956a931-196a-4f29-bee1-ba2f07a02f73 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:05.781693 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5956a931-196a-4f29-bee1-ba2f07a02f73 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:05.913011 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-5956a931-196a-4f29-bee1-ba2f07a02f73 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:05.921433 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-5956a931-196a-4f29-bee1-ba2f07a02f73 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:05.922946 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-5956a931-196a-4f29-bee1-ba2f07a02f73 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:05.924095 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5956a931-196a-4f29-bee1-ba2f07a02f73 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1743 microversion: 2.20 time: 0.258692 Oct 28 08:45:05.924656 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 442/889] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:05 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1743 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:45:05.974570 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-924080ae-3f5f-490d-b124-a2ae239d0528 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:05.975285 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-924080ae-3f5f-490d-b124-a2ae239d0528 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:05.984510 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-924080ae-3f5f-490d-b124-a2ae239d0528 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:05.984997 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-924080ae-3f5f-490d-b124-a2ae239d0528 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:05.985958 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-924080ae-3f5f-490d-b124-a2ae239d0528 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:05.988903 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-924080ae-3f5f-490d-b124-a2ae239d0528 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:06.115579 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-924080ae-3f5f-490d-b124-a2ae239d0528 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:06.123730 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-924080ae-3f5f-490d-b124-a2ae239d0528 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1722 microversion: 2.1 time: 0.152874 Oct 28 08:45:06.124295 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 448/890] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:05 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:06.942484 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cd0e6e9a-855d-461a-9657-d3cf4ab9f4be tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:06.943200 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cd0e6e9a-855d-461a-9657-d3cf4ab9f4be tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:06.950025 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd0e6e9a-855d-461a-9657-d3cf4ab9f4be tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:06.950588 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd0e6e9a-855d-461a-9657-d3cf4ab9f4be tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:06.951613 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd0e6e9a-855d-461a-9657-d3cf4ab9f4be tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:06.952068 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd0e6e9a-855d-461a-9657-d3cf4ab9f4be tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:07.081468 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-cd0e6e9a-855d-461a-9657-d3cf4ab9f4be tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:07.089053 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-cd0e6e9a-855d-461a-9657-d3cf4ab9f4be tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:07.090576 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-cd0e6e9a-855d-461a-9657-d3cf4ab9f4be tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:07.092446 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cd0e6e9a-855d-461a-9657-d3cf4ab9f4be tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1743 microversion: 2.20 time: 0.154044 Oct 28 08:45:07.093170 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 443/891] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:06 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:07.141032 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bab27cc3-dfba-470a-9a5a-86d5a156c619 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:07.141653 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bab27cc3-dfba-470a-9a5a-86d5a156c619 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:07.147853 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bab27cc3-dfba-470a-9a5a-86d5a156c619 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:07.148296 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bab27cc3-dfba-470a-9a5a-86d5a156c619 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:07.149061 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bab27cc3-dfba-470a-9a5a-86d5a156c619 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:07.149485 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bab27cc3-dfba-470a-9a5a-86d5a156c619 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:07.288739 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-bab27cc3-dfba-470a-9a5a-86d5a156c619 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:07.298884 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bab27cc3-dfba-470a-9a5a-86d5a156c619 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1722 microversion: 2.1 time: 0.161541 Oct 28 08:45:07.299724 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 449/892] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:07 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:08.111800 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-567b2222-6afa-4b60-a69e-05e8c62c628a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:08.112530 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-567b2222-6afa-4b60-a69e-05e8c62c628a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:08.118692 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-567b2222-6afa-4b60-a69e-05e8c62c628a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:08.119147 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-567b2222-6afa-4b60-a69e-05e8c62c628a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:08.119914 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-567b2222-6afa-4b60-a69e-05e8c62c628a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:08.120480 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-567b2222-6afa-4b60-a69e-05e8c62c628a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:08.252848 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-567b2222-6afa-4b60-a69e-05e8c62c628a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:08.260530 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-567b2222-6afa-4b60-a69e-05e8c62c628a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:08.261925 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-567b2222-6afa-4b60-a69e-05e8c62c628a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:08.263810 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-567b2222-6afa-4b60-a69e-05e8c62c628a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1743 microversion: 2.20 time: 0.155115 Oct 28 08:45:08.264362 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 444/893] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:08 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:08.317137 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2f399217-587e-4297-b437-73928dc59c67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:08.317769 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2f399217-587e-4297-b437-73928dc59c67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:08.323940 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f399217-587e-4297-b437-73928dc59c67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:08.324389 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f399217-587e-4297-b437-73928dc59c67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:08.325898 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f399217-587e-4297-b437-73928dc59c67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:08.326346 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f399217-587e-4297-b437-73928dc59c67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:08.461233 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-2f399217-587e-4297-b437-73928dc59c67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:08.469743 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2f399217-587e-4297-b437-73928dc59c67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1722 microversion: 2.1 time: 0.156078 Oct 28 08:45:08.470324 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 450/894] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:08 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:09.132842 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-e264e331-5e58-4f0e-8542-7d9cf76bf281 req-3a61139e-72d7-4703-b1a6-60b046491f69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e3ca69d-4e09-4205-b6ec-2a6189724e46", "name": "network-vif-plugged", "status": "completed", "tag": "b51a5869-7eac-401f-ad13-59a689851a50"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:45:09.136159 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:45:09.136159 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:45:09.157183 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e264e331-5e58-4f0e-8542-7d9cf76bf281 req-3a61139e-72d7-4703-b1a6-60b046491f69 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:09.157913 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e264e331-5e58-4f0e-8542-7d9cf76bf281 req-3a61139e-72d7-4703-b1a6-60b046491f69 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:09.171272 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-e264e331-5e58-4f0e-8542-7d9cf76bf281 req-3a61139e-72d7-4703-b1a6-60b046491f69 service nova] Creating event network-vif-plugged:b51a5869-7eac-401f-ad13-59a689851a50 for instance 4e3ca69d-4e09-4205-b6ec-2a6189724e46 on hv-cinder-81565 Oct 28 08:45:09.176807 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-e264e331-5e58-4f0e-8542-7d9cf76bf281 req-3a61139e-72d7-4703-b1a6-60b046491f69 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048026 Oct 28 08:45:09.177575 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 445/895] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:45:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:45:09.281990 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ff602bf2-bd61-46ad-a650-0c4504903b20 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:09.282745 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ff602bf2-bd61-46ad-a650-0c4504903b20 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:09.289489 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff602bf2-bd61-46ad-a650-0c4504903b20 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:09.290260 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff602bf2-bd61-46ad-a650-0c4504903b20 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:09.291108 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff602bf2-bd61-46ad-a650-0c4504903b20 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:09.291539 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff602bf2-bd61-46ad-a650-0c4504903b20 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:09.420735 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-ff602bf2-bd61-46ad-a650-0c4504903b20 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:09.429176 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-ff602bf2-bd61-46ad-a650-0c4504903b20 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:09.430714 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-ff602bf2-bd61-46ad-a650-0c4504903b20 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:09.431863 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ff602bf2-bd61-46ad-a650-0c4504903b20 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1743 microversion: 2.20 time: 0.153795 Oct 28 08:45:09.432402 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 451/896] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:09 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:45:09.487908 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-beb39af1-997f-4d25-b63c-45720618b4f9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:09.488607 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-beb39af1-997f-4d25-b63c-45720618b4f9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:09.494894 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-beb39af1-997f-4d25-b63c-45720618b4f9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:09.495341 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-beb39af1-997f-4d25-b63c-45720618b4f9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:09.496106 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-beb39af1-997f-4d25-b63c-45720618b4f9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:09.496538 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-beb39af1-997f-4d25-b63c-45720618b4f9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:09.623103 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-beb39af1-997f-4d25-b63c-45720618b4f9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:09.631087 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-beb39af1-997f-4d25-b63c-45720618b4f9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1722 microversion: 2.1 time: 0.147183 Oct 28 08:45:09.631647 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 446/897] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:09 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:10.452346 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-526b92a8-ac2f-43c2-93f5-f97f1846727a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:10.452886 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-526b92a8-ac2f-43c2-93f5-f97f1846727a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:10.459151 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-526b92a8-ac2f-43c2-93f5-f97f1846727a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:10.459587 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-526b92a8-ac2f-43c2-93f5-f97f1846727a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:10.460354 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-526b92a8-ac2f-43c2-93f5-f97f1846727a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:10.460769 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-526b92a8-ac2f-43c2-93f5-f97f1846727a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:10.590327 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-526b92a8-ac2f-43c2-93f5-f97f1846727a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:10.599115 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-526b92a8-ac2f-43c2-93f5-f97f1846727a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:10.600602 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-526b92a8-ac2f-43c2-93f5-f97f1846727a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:10.601749 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-526b92a8-ac2f-43c2-93f5-f97f1846727a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1743 microversion: 2.20 time: 0.154363 Oct 28 08:45:10.602305 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 452/898] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:10 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:10.647959 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6708b9a9-e59f-45a4-aadf-38cd246182fb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:10.648597 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6708b9a9-e59f-45a4-aadf-38cd246182fb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:10.656651 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6708b9a9-e59f-45a4-aadf-38cd246182fb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:10.657102 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6708b9a9-e59f-45a4-aadf-38cd246182fb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:10.658039 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6708b9a9-e59f-45a4-aadf-38cd246182fb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:10.658530 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6708b9a9-e59f-45a4-aadf-38cd246182fb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:10.783673 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-6708b9a9-e59f-45a4-aadf-38cd246182fb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:10.791412 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6708b9a9-e59f-45a4-aadf-38cd246182fb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1699 microversion: 2.1 time: 0.147568 Oct 28 08:45:10.791970 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 447/899] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:10 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1699 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:10.807497 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-66154169-5959-4ec0-afe2-4a2a452a52c1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:45:10.814836 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66154169-5959-4ec0-afe2-4a2a452a52c1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:10.815277 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66154169-5959-4ec0-afe2-4a2a452a52c1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:10.875954 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-66154169-5959-4ec0-afe2-4a2a452a52c1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Going to try to start instance {{(pid=122257) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 28 08:45:10.917756 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-66154169-5959-4ec0-afe2-4a2a452a52c1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 202 len: 0 microversion: 2.1 time: 0.113691 Oct 28 08:45:10.918461 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 453/900] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:45:10 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:45:10.926191 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5a372c76-2a0f-4c82-b9a3-4d2cfc44c7e5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:10.926815 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5a372c76-2a0f-4c82-b9a3-4d2cfc44c7e5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:10.932473 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a372c76-2a0f-4c82-b9a3-4d2cfc44c7e5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:10.932914 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a372c76-2a0f-4c82-b9a3-4d2cfc44c7e5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:10.933707 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a372c76-2a0f-4c82-b9a3-4d2cfc44c7e5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:10.934116 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a372c76-2a0f-4c82-b9a3-4d2cfc44c7e5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:11.071199 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-5a372c76-2a0f-4c82-b9a3-4d2cfc44c7e5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:11.084139 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5a372c76-2a0f-4c82-b9a3-4d2cfc44c7e5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1708 microversion: 2.1 time: 0.161474 Oct 28 08:45:11.084942 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 448/901] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:10 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1708 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:11.621643 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cec468f3-b04a-4dec-87f5-f3e9aadb64ca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:11.622599 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cec468f3-b04a-4dec-87f5-f3e9aadb64ca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:11.628767 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cec468f3-b04a-4dec-87f5-f3e9aadb64ca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:11.629209 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cec468f3-b04a-4dec-87f5-f3e9aadb64ca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:11.629973 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cec468f3-b04a-4dec-87f5-f3e9aadb64ca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:11.630703 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cec468f3-b04a-4dec-87f5-f3e9aadb64ca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:11.820186 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-cec468f3-b04a-4dec-87f5-f3e9aadb64ca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:11.828650 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-cec468f3-b04a-4dec-87f5-f3e9aadb64ca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:11.830097 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-cec468f3-b04a-4dec-87f5-f3e9aadb64ca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:11.831284 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cec468f3-b04a-4dec-87f5-f3e9aadb64ca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1743 microversion: 2.20 time: 0.214486 Oct 28 08:45:11.831849 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 454/902] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:11 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1743 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:12.102409 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0182e84c-7183-4510-b2a1-277cee2305c2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:12.103046 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0182e84c-7183-4510-b2a1-277cee2305c2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:12.109542 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0182e84c-7183-4510-b2a1-277cee2305c2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:12.110000 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0182e84c-7183-4510-b2a1-277cee2305c2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:12.110781 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0182e84c-7183-4510-b2a1-277cee2305c2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:12.111231 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0182e84c-7183-4510-b2a1-277cee2305c2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:12.236031 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-0182e84c-7183-4510-b2a1-277cee2305c2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:12.243978 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0182e84c-7183-4510-b2a1-277cee2305c2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1708 microversion: 2.1 time: 0.145339 Oct 28 08:45:12.244536 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 449/903] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:12 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1708 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:12.849194 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-679a284d-5971-48be-956a-47d13460b6cc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:12.849896 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-679a284d-5971-48be-956a-47d13460b6cc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:12.858904 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-679a284d-5971-48be-956a-47d13460b6cc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:12.859348 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-679a284d-5971-48be-956a-47d13460b6cc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:12.860134 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-679a284d-5971-48be-956a-47d13460b6cc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:12.860552 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-679a284d-5971-48be-956a-47d13460b6cc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:13.003713 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-679a284d-5971-48be-956a-47d13460b6cc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:13.011365 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-679a284d-5971-48be-956a-47d13460b6cc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:13.012896 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-679a284d-5971-48be-956a-47d13460b6cc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:13.014418 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-679a284d-5971-48be-956a-47d13460b6cc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1738 microversion: 2.20 time: 0.168916 Oct 28 08:45:13.015019 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 455/904] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:12 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:13.261919 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-31cec0e8-1eda-4ab1-bae5-3e82efc195fa tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:13.263311 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-31cec0e8-1eda-4ab1-bae5-3e82efc195fa tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:13.269286 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31cec0e8-1eda-4ab1-bae5-3e82efc195fa tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:13.269741 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31cec0e8-1eda-4ab1-bae5-3e82efc195fa tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:13.270529 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31cec0e8-1eda-4ab1-bae5-3e82efc195fa tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:13.270965 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31cec0e8-1eda-4ab1-bae5-3e82efc195fa tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:13.425764 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-31cec0e8-1eda-4ab1-bae5-3e82efc195fa tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:13.435364 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-31cec0e8-1eda-4ab1-bae5-3e82efc195fa tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1712 microversion: 2.1 time: 0.177106 Oct 28 08:45:13.437360 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 450/905] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:13 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1712 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:14.044482 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c0a87ac1-8c2a-4c44-ab10-9dd625d7d3ae tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:14.046396 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c0a87ac1-8c2a-4c44-ab10-9dd625d7d3ae tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:14.053103 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0a87ac1-8c2a-4c44-ab10-9dd625d7d3ae tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:14.053629 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0a87ac1-8c2a-4c44-ab10-9dd625d7d3ae tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:14.054660 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0a87ac1-8c2a-4c44-ab10-9dd625d7d3ae tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:14.055288 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0a87ac1-8c2a-4c44-ab10-9dd625d7d3ae tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:14.213217 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-c0a87ac1-8c2a-4c44-ab10-9dd625d7d3ae tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:14.222974 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-c0a87ac1-8c2a-4c44-ab10-9dd625d7d3ae tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:14.224461 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-c0a87ac1-8c2a-4c44-ab10-9dd625d7d3ae tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:14.225616 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c0a87ac1-8c2a-4c44-ab10-9dd625d7d3ae tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1738 microversion: 2.20 time: 0.185523 Oct 28 08:45:14.226851 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 456/906] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:14 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:15.244770 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-516366b4-3344-4230-9e08-e86ff115a1e2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:15.245375 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-516366b4-3344-4230-9e08-e86ff115a1e2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:15.252700 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-516366b4-3344-4230-9e08-e86ff115a1e2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:15.253139 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-516366b4-3344-4230-9e08-e86ff115a1e2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:15.254418 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-516366b4-3344-4230-9e08-e86ff115a1e2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:15.255102 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-516366b4-3344-4230-9e08-e86ff115a1e2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:15.438130 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-516366b4-3344-4230-9e08-e86ff115a1e2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:15.454141 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-516366b4-3344-4230-9e08-e86ff115a1e2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:15.456053 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-516366b4-3344-4230-9e08-e86ff115a1e2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:15.456878 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-516366b4-3344-4230-9e08-e86ff115a1e2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1738 microversion: 2.20 time: 0.215826 Oct 28 08:45:15.457437 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 451/907] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:15 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1738 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:16.476397 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4d72cef1-3477-414a-a5c7-a1511314fb70 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:16.476993 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4d72cef1-3477-414a-a5c7-a1511314fb70 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:16.484317 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d72cef1-3477-414a-a5c7-a1511314fb70 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:16.484661 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d72cef1-3477-414a-a5c7-a1511314fb70 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:16.485597 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d72cef1-3477-414a-a5c7-a1511314fb70 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:16.485950 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d72cef1-3477-414a-a5c7-a1511314fb70 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:16.618723 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-4d72cef1-3477-414a-a5c7-a1511314fb70 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:16.627043 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-4d72cef1-3477-414a-a5c7-a1511314fb70 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:16.628540 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-4d72cef1-3477-414a-a5c7-a1511314fb70 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:16.629686 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4d72cef1-3477-414a-a5c7-a1511314fb70 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1738 microversion: 2.20 time: 0.157716 Oct 28 08:45:16.630237 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 457/908] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:16 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:45:17.649947 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a981f990-f386-45c4-a467-8355b6fd1d96 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:17.651918 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a981f990-f386-45c4-a467-8355b6fd1d96 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:17.662341 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a981f990-f386-45c4-a467-8355b6fd1d96 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:17.663261 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a981f990-f386-45c4-a467-8355b6fd1d96 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:17.664336 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a981f990-f386-45c4-a467-8355b6fd1d96 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:17.665060 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a981f990-f386-45c4-a467-8355b6fd1d96 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:17.805830 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-a981f990-f386-45c4-a467-8355b6fd1d96 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:17.815784 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-a981f990-f386-45c4-a467-8355b6fd1d96 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:17.817630 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-a981f990-f386-45c4-a467-8355b6fd1d96 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:17.818945 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a981f990-f386-45c4-a467-8355b6fd1d96 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1738 microversion: 2.20 time: 0.174443 Oct 28 08:45:17.820035 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 452/909] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:17 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:18.220993 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d7af37c2-5ac1-4280-ab6b-890e94e5d50c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1638353785", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-859765321", "security_groups": [{"name": "tempest-secgroup-smoke-1106737513"}], "networks": [{"uuid": "b9fd429e-0719-42cd-a50a-a983af1510cd"}], "block_device_mapping_v2": [{"uuid": "0d24b5e9-be7a-4639-84a4-58c54dd9c7a8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:45:18.333777 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-d7af37c2-5ac1-4280-ab6b-890e94e5d50c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] validate_networks() for [('b9fd429e-0719-42cd-a50a-a983af1510cd', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:45:18.840349 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-197922c7-2c0f-439f-b62d-c7404430b382 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:18.842196 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d7af37c2-5ac1-4280-ab6b-890e94e5d50c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:45:18.842666 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d7af37c2-5ac1-4280-ab6b-890e94e5d50c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:45:18.843007 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-197922c7-2c0f-439f-b62d-c7404430b382 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:18.843289 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d7af37c2-5ac1-4280-ab6b-890e94e5d50c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:45:18.846164 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d7af37c2-5ac1-4280-ab6b-890e94e5d50c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:45:18.847246 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d7af37c2-5ac1-4280-ab6b-890e94e5d50c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:45:18.850054 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-197922c7-2c0f-439f-b62d-c7404430b382 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:18.850755 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-197922c7-2c0f-439f-b62d-c7404430b382 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:18.851709 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-197922c7-2c0f-439f-b62d-c7404430b382 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:18.852434 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-197922c7-2c0f-439f-b62d-c7404430b382 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:18.861383 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d7af37c2-5ac1-4280-ab6b-890e94e5d50c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:18.861958 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d7af37c2-5ac1-4280-ab6b-890e94e5d50c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:18.862882 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d7af37c2-5ac1-4280-ab6b-890e94e5d50c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:18.863945 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d7af37c2-5ac1-4280-ab6b-890e94e5d50c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:18.883921 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-d7af37c2-5ac1-4280-ab6b-890e94e5d50c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Getting quotas for project 3b5a1400e6c8401a9ac7192333826fde. Resources: {'instances', 'cores', 'ram'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:45:18.888454 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-d7af37c2-5ac1-4280-ab6b-890e94e5d50c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Getting quotas for user f262d208d53949b8a1836c8aa4fc3376 and project 3b5a1400e6c8401a9ac7192333826fde. Resources: {'instances', 'cores', 'ram'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:45:18.976320 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d7af37c2-5ac1-4280-ab6b-890e94e5d50c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:45:18.978978 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d7af37c2-5ac1-4280-ab6b-890e94e5d50c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0d24b5e9-be7a-4639-84a4-58c54dd9c7a8',volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:45:19.031822 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-197922c7-2c0f-439f-b62d-c7404430b382 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:19.040856 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-197922c7-2c0f-439f-b62d-c7404430b382 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:19.048775 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-197922c7-2c0f-439f-b62d-c7404430b382 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:19.050081 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-197922c7-2c0f-439f-b62d-c7404430b382 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1738 microversion: 2.20 time: 0.213460 Oct 28 08:45:19.061158 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 453/910] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:18 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:19.136819 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d7af37c2-5ac1-4280-ab6b-890e94e5d50c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.920793 Oct 28 08:45:19.138552 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 458/911] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Oct 28 08:45:18 2021] POST /compute/v2.1/servers => generated 406 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 08:45:19.148138 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9cc48a2a-77f6-4615-a9b9-32301e9c6239 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:19.149104 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9cc48a2a-77f6-4615-a9b9-32301e9c6239 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:19.222991 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-9cc48a2a-77f6-4615-a9b9-32301e9c6239 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:19.230606 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9cc48a2a-77f6-4615-a9b9-32301e9c6239 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1088 microversion: 2.1 time: 0.086123 Oct 28 08:45:19.241950 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 454/912] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:19 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1088 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:45:20.069226 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-26849426-d0a2-4b40-a423-2511a23c8f82 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:20.070689 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-26849426-d0a2-4b40-a423-2511a23c8f82 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:20.078965 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26849426-d0a2-4b40-a423-2511a23c8f82 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:20.080013 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26849426-d0a2-4b40-a423-2511a23c8f82 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:20.081253 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26849426-d0a2-4b40-a423-2511a23c8f82 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:20.086554 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26849426-d0a2-4b40-a423-2511a23c8f82 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:20.249526 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-419d89d6-79ba-4b70-b4d5-79028788f33b tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:20.250047 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-26849426-d0a2-4b40-a423-2511a23c8f82 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:20.250176 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-419d89d6-79ba-4b70-b4d5-79028788f33b tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:20.256950 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-419d89d6-79ba-4b70-b4d5-79028788f33b tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:20.257868 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-419d89d6-79ba-4b70-b4d5-79028788f33b tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:20.258918 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-419d89d6-79ba-4b70-b4d5-79028788f33b tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:20.259558 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-419d89d6-79ba-4b70-b4d5-79028788f33b tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:20.268542 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-26849426-d0a2-4b40-a423-2511a23c8f82 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:20.272711 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-26849426-d0a2-4b40-a423-2511a23c8f82 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:20.273908 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-26849426-d0a2-4b40-a423-2511a23c8f82 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1738 microversion: 2.20 time: 0.209087 Oct 28 08:45:20.276939 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 459/913] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:20 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1738 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:20.342992 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-419d89d6-79ba-4b70-b4d5-79028788f33b tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:20.355257 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-419d89d6-79ba-4b70-b4d5-79028788f33b tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1186 microversion: 2.1 time: 0.110472 Oct 28 08:45:20.366577 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 455/914] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:20 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1186 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:21.294452 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-22f7bb61-d619-487f-8546-f5df6c4bc8eb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:21.295760 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-22f7bb61-d619-487f-8546-f5df6c4bc8eb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:21.303882 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22f7bb61-d619-487f-8546-f5df6c4bc8eb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:21.304657 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22f7bb61-d619-487f-8546-f5df6c4bc8eb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:21.305858 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22f7bb61-d619-487f-8546-f5df6c4bc8eb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:21.306524 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22f7bb61-d619-487f-8546-f5df6c4bc8eb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:21.374033 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-af288093-1d0f-49ac-9fc8-2cfb7535bece tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:21.374613 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-af288093-1d0f-49ac-9fc8-2cfb7535bece tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:21.381386 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af288093-1d0f-49ac-9fc8-2cfb7535bece tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:21.382137 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af288093-1d0f-49ac-9fc8-2cfb7535bece tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:21.383166 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af288093-1d0f-49ac-9fc8-2cfb7535bece tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:21.383795 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af288093-1d0f-49ac-9fc8-2cfb7535bece tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:21.513846 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-af288093-1d0f-49ac-9fc8-2cfb7535bece tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:21.523697 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-af288093-1d0f-49ac-9fc8-2cfb7535bece tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1192 microversion: 2.1 time: 0.153473 Oct 28 08:45:21.525125 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 456/915] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:21 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1192 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:21.621449 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-22f7bb61-d619-487f-8546-f5df6c4bc8eb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:21.631230 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-22f7bb61-d619-487f-8546-f5df6c4bc8eb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:21.633634 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-22f7bb61-d619-487f-8546-f5df6c4bc8eb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:21.634841 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-22f7bb61-d619-487f-8546-f5df6c4bc8eb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1738 microversion: 2.20 time: 0.345315 Oct 28 08:45:21.647237 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 460/916] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:21 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1738 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:22.541104 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-63714efc-9488-4661-b0ab-14d3f3bb1616 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:22.542446 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-63714efc-9488-4661-b0ab-14d3f3bb1616 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:22.551623 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63714efc-9488-4661-b0ab-14d3f3bb1616 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:22.552353 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63714efc-9488-4661-b0ab-14d3f3bb1616 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:22.553514 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63714efc-9488-4661-b0ab-14d3f3bb1616 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:22.554103 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63714efc-9488-4661-b0ab-14d3f3bb1616 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:22.654534 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-74f940e6-32b1-426c-8dc6-c53d5da1e1e4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:22.655087 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-74f940e6-32b1-426c-8dc6-c53d5da1e1e4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:22.671416 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74f940e6-32b1-426c-8dc6-c53d5da1e1e4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:22.673226 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74f940e6-32b1-426c-8dc6-c53d5da1e1e4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:22.674210 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74f940e6-32b1-426c-8dc6-c53d5da1e1e4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:22.677589 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74f940e6-32b1-426c-8dc6-c53d5da1e1e4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:22.912266 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-63714efc-9488-4661-b0ab-14d3f3bb1616 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:22.944324 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-63714efc-9488-4661-b0ab-14d3f3bb1616 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1260 microversion: 2.1 time: 0.406984 Oct 28 08:45:22.951051 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 457/917] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:22 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1260 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:23.062442 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-74f940e6-32b1-426c-8dc6-c53d5da1e1e4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:23.077765 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-74f940e6-32b1-426c-8dc6-c53d5da1e1e4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:23.082416 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-74f940e6-32b1-426c-8dc6-c53d5da1e1e4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:23.086309 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-74f940e6-32b1-426c-8dc6-c53d5da1e1e4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1738 microversion: 2.20 time: 0.436857 Oct 28 08:45:23.113062 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 461/918] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:22 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1738 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:45:23.193160 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-8ece20c6-c3ec-4383-83d4-d21981995cda req-3c93d5cd-cd04-420f-9757-cc557996da77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de3329c3-6608-4f3d-a14e-a1c563567ca1", "tag": "0740398f-07ce-4e13-b20f-5cf387cc8ba7"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:45:23.195350 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:45:23.195350 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:45:23.203759 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8ece20c6-c3ec-4383-83d4-d21981995cda req-3c93d5cd-cd04-420f-9757-cc557996da77 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:23.204616 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8ece20c6-c3ec-4383-83d4-d21981995cda req-3c93d5cd-cd04-420f-9757-cc557996da77 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:23.216611 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-8ece20c6-c3ec-4383-83d4-d21981995cda req-3c93d5cd-cd04-420f-9757-cc557996da77 service nova] Creating event network-changed:0740398f-07ce-4e13-b20f-5cf387cc8ba7 for instance de3329c3-6608-4f3d-a14e-a1c563567ca1 on hv-cinder-81565 Oct 28 08:45:23.224517 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-8ece20c6-c3ec-4383-83d4-d21981995cda req-3c93d5cd-cd04-420f-9757-cc557996da77 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.271434 Oct 28 08:45:23.225512 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 458/919] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:45:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:45:23.968386 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3229eac7-cf3c-4863-8cb9-7c51aeda230e tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:23.970672 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3229eac7-cf3c-4863-8cb9-7c51aeda230e tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:23.980124 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3229eac7-cf3c-4863-8cb9-7c51aeda230e tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:23.980872 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3229eac7-cf3c-4863-8cb9-7c51aeda230e tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:23.982055 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3229eac7-cf3c-4863-8cb9-7c51aeda230e tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:23.982692 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3229eac7-cf3c-4863-8cb9-7c51aeda230e tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:24.110441 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a3f75deb-48df-4a78-888d-706b04f32495 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:24.112583 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a3f75deb-48df-4a78-888d-706b04f32495 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:24.123649 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a3f75deb-48df-4a78-888d-706b04f32495 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:24.124697 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a3f75deb-48df-4a78-888d-706b04f32495 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:24.126116 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a3f75deb-48df-4a78-888d-706b04f32495 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:24.126870 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a3f75deb-48df-4a78-888d-706b04f32495 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:24.245509 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3229eac7-cf3c-4863-8cb9-7c51aeda230e tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:24.255671 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3229eac7-cf3c-4863-8cb9-7c51aeda230e tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1260 microversion: 2.1 time: 0.292018 Oct 28 08:45:24.257053 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 462/920] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:23 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1260 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:24.312526 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-a3f75deb-48df-4a78-888d-706b04f32495 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:24.321688 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-a3f75deb-48df-4a78-888d-706b04f32495 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:24.323251 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-a3f75deb-48df-4a78-888d-706b04f32495 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:24.324616 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a3f75deb-48df-4a78-888d-706b04f32495 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1738 microversion: 2.20 time: 0.218773 Oct 28 08:45:24.335800 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 459/921] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:24 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:25.273462 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1e4eda59-223c-438a-bb04-5c1be7f0def0 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:25.274099 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1e4eda59-223c-438a-bb04-5c1be7f0def0 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:25.280461 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e4eda59-223c-438a-bb04-5c1be7f0def0 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:25.280898 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e4eda59-223c-438a-bb04-5c1be7f0def0 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:25.281656 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e4eda59-223c-438a-bb04-5c1be7f0def0 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:25.282082 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e4eda59-223c-438a-bb04-5c1be7f0def0 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:25.344172 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9c6d41db-44e6-44d0-87b3-bd522f11e887 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:25.344810 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9c6d41db-44e6-44d0-87b3-bd522f11e887 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:25.351250 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c6d41db-44e6-44d0-87b3-bd522f11e887 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:25.351634 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c6d41db-44e6-44d0-87b3-bd522f11e887 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:25.352398 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c6d41db-44e6-44d0-87b3-bd522f11e887 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:25.352822 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c6d41db-44e6-44d0-87b3-bd522f11e887 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:25.435810 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1e4eda59-223c-438a-bb04-5c1be7f0def0 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:25.443282 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1e4eda59-223c-438a-bb04-5c1be7f0def0 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1260 microversion: 2.1 time: 0.173339 Oct 28 08:45:25.443731 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 463/922] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:25 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:25.492258 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-9c6d41db-44e6-44d0-87b3-bd522f11e887 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:25.500951 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-9c6d41db-44e6-44d0-87b3-bd522f11e887 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:25.503083 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-9c6d41db-44e6-44d0-87b3-bd522f11e887 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:25.504438 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9c6d41db-44e6-44d0-87b3-bd522f11e887 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1738 microversion: 2.20 time: 0.164823 Oct 28 08:45:25.505026 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 460/923] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:25 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:45:26.461216 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-825a4373-14d4-4a6e-a748-26cd6b3ac0d1 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:26.461974 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-825a4373-14d4-4a6e-a748-26cd6b3ac0d1 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:26.469253 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-825a4373-14d4-4a6e-a748-26cd6b3ac0d1 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:26.469691 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-825a4373-14d4-4a6e-a748-26cd6b3ac0d1 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:26.470489 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-825a4373-14d4-4a6e-a748-26cd6b3ac0d1 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:26.470935 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-825a4373-14d4-4a6e-a748-26cd6b3ac0d1 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:26.523722 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b1e78134-ea84-42c4-99fe-364b8fe30be6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:26.524433 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b1e78134-ea84-42c4-99fe-364b8fe30be6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:26.531881 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1e78134-ea84-42c4-99fe-364b8fe30be6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:26.532323 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1e78134-ea84-42c4-99fe-364b8fe30be6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:26.533084 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1e78134-ea84-42c4-99fe-364b8fe30be6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:26.533504 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1e78134-ea84-42c4-99fe-364b8fe30be6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:26.627035 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-825a4373-14d4-4a6e-a748-26cd6b3ac0d1 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:26.634240 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-825a4373-14d4-4a6e-a748-26cd6b3ac0d1 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1260 microversion: 2.1 time: 0.177310 Oct 28 08:45:26.634855 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 464/924] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:26 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:26.685933 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-b1e78134-ea84-42c4-99fe-364b8fe30be6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:26.693783 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-b1e78134-ea84-42c4-99fe-364b8fe30be6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:26.695340 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-b1e78134-ea84-42c4-99fe-364b8fe30be6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:26.696492 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b1e78134-ea84-42c4-99fe-364b8fe30be6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1720 microversion: 2.20 time: 0.176455 Oct 28 08:45:26.697060 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 461/925] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:26 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:45:27.650831 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-145b4455-3b02-4fed-b35e-2410027f2a30 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:27.651435 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-145b4455-3b02-4fed-b35e-2410027f2a30 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:27.658030 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-145b4455-3b02-4fed-b35e-2410027f2a30 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:27.658484 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-145b4455-3b02-4fed-b35e-2410027f2a30 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:27.659260 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-145b4455-3b02-4fed-b35e-2410027f2a30 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:27.659681 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-145b4455-3b02-4fed-b35e-2410027f2a30 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:27.720151 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-91129d42-2319-427d-9e80-836b57df165d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:27.721224 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-91129d42-2319-427d-9e80-836b57df165d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:27.727922 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91129d42-2319-427d-9e80-836b57df165d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:27.728503 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91129d42-2319-427d-9e80-836b57df165d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:27.729284 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91129d42-2319-427d-9e80-836b57df165d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:27.729780 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91129d42-2319-427d-9e80-836b57df165d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:27.816196 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-145b4455-3b02-4fed-b35e-2410027f2a30 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:27.823552 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-145b4455-3b02-4fed-b35e-2410027f2a30 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1260 microversion: 2.1 time: 0.176302 Oct 28 08:45:27.824137 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 465/926] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:27 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:27.873768 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-91129d42-2319-427d-9e80-836b57df165d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:27.881564 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-91129d42-2319-427d-9e80-836b57df165d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:27.883099 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-91129d42-2319-427d-9e80-836b57df165d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:27.884230 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-91129d42-2319-427d-9e80-836b57df165d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1720 microversion: 2.20 time: 0.168857 Oct 28 08:45:27.884774 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 462/927] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:27 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:28.840299 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3a54e220-fb94-45c1-a67e-ae7e9fcb8cbe tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:28.840970 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3a54e220-fb94-45c1-a67e-ae7e9fcb8cbe tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:28.847862 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a54e220-fb94-45c1-a67e-ae7e9fcb8cbe tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:28.848061 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a54e220-fb94-45c1-a67e-ae7e9fcb8cbe tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:28.848823 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a54e220-fb94-45c1-a67e-ae7e9fcb8cbe tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:28.849248 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a54e220-fb94-45c1-a67e-ae7e9fcb8cbe tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:28.902662 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-743492d4-b50c-4ddb-9eac-7ec0c0a4ea93 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:28.903877 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-743492d4-b50c-4ddb-9eac-7ec0c0a4ea93 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:28.910268 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-743492d4-b50c-4ddb-9eac-7ec0c0a4ea93 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:28.910759 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-743492d4-b50c-4ddb-9eac-7ec0c0a4ea93 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:28.911529 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-743492d4-b50c-4ddb-9eac-7ec0c0a4ea93 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:28.911956 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-743492d4-b50c-4ddb-9eac-7ec0c0a4ea93 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:29.003385 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3a54e220-fb94-45c1-a67e-ae7e9fcb8cbe tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:29.010814 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3a54e220-fb94-45c1-a67e-ae7e9fcb8cbe tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1260 microversion: 2.1 time: 0.174198 Oct 28 08:45:29.011565 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 466/928] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:28 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:29.060844 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-743492d4-b50c-4ddb-9eac-7ec0c0a4ea93 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:29.068667 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-743492d4-b50c-4ddb-9eac-7ec0c0a4ea93 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:29.070372 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-743492d4-b50c-4ddb-9eac-7ec0c0a4ea93 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:29.071556 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-743492d4-b50c-4ddb-9eac-7ec0c0a4ea93 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1723 microversion: 2.20 time: 0.172709 Oct 28 08:45:29.072112 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 463/929] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:28 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:45:29.089716 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-20acded2-dcdb-4654-9ebe-6720b060ed0e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c315ff7-d73b-4e98-97b8-4befd42c223d"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:45:29.095892 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-20acded2-dcdb-4654-9ebe-6720b060ed0e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:29.101861 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20acded2-dcdb-4654-9ebe-6720b060ed0e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:29.102306 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20acded2-dcdb-4654-9ebe-6720b060ed0e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:29.103158 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20acded2-dcdb-4654-9ebe-6720b060ed0e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:29.103584 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20acded2-dcdb-4654-9ebe-6720b060ed0e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:29.177543 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-7709d7ab-54a9-4503-87d4-36e3b355b71d req-133efb17-d0e8-4dcc-97ea-8b4f91bf4951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e3ca69d-4e09-4205-b6ec-2a6189724e46", "name": "network-vif-unplugged", "status": "completed", "tag": "b51a5869-7eac-401f-ad13-59a689851a50"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:45:29.180043 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:45:29.180043 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:45:29.189619 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-7709d7ab-54a9-4503-87d4-36e3b355b71d req-133efb17-d0e8-4dcc-97ea-8b4f91bf4951 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:29.190000 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-7709d7ab-54a9-4503-87d4-36e3b355b71d req-133efb17-d0e8-4dcc-97ea-8b4f91bf4951 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:29.202483 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.compute.server_external_events [req-7709d7ab-54a9-4503-87d4-36e3b355b71d req-133efb17-d0e8-4dcc-97ea-8b4f91bf4951 service nova] Unable to find a host for instance 4e3ca69d-4e09-4205-b6ec-2a6189724e46. Dropping event network-vif-unplugged {{(pid=122256) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Oct 28 08:45:29.203698 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-7709d7ab-54a9-4503-87d4-36e3b355b71d req-133efb17-d0e8-4dcc-97ea-8b4f91bf4951 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030410 Oct 28 08:45:29.204791 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 464/930] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:45:29 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 28 08:45:29.407191 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-20acded2-dcdb-4654-9ebe-6720b060ed0e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.321244 Oct 28 08:45:29.407975 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 467/931] 10.222.0.76 () {62 vars in 1363 bytes} [Thu Oct 28 08:45:29 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/os-volume_attachments => generated 188 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:45:29.524690 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-360a9705-804a-4f0f-a8c1-a6d0e2194580 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:45:29.525173 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-360a9705-804a-4f0f-a8c1-a6d0e2194580 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:29.531149 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-360a9705-804a-4f0f-a8c1-a6d0e2194580 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:29.531590 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-360a9705-804a-4f0f-a8c1-a6d0e2194580 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:29.532360 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-360a9705-804a-4f0f-a8c1-a6d0e2194580 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:29.532785 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-360a9705-804a-4f0f-a8c1-a6d0e2194580 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:29.666560 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-360a9705-804a-4f0f-a8c1-a6d0e2194580 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action" status: 202 len: 0 microversion: 2.20 time: 0.145593 Oct 28 08:45:29.667188 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 465/932] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:45:29 2021] POST /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:45:29.675880 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-90501baa-a278-42cb-b92d-725f476770b7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:29.676574 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-90501baa-a278-42cb-b92d-725f476770b7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:29.683398 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90501baa-a278-42cb-b92d-725f476770b7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:29.683844 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90501baa-a278-42cb-b92d-725f476770b7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:29.685137 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90501baa-a278-42cb-b92d-725f476770b7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:29.685712 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90501baa-a278-42cb-b92d-725f476770b7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:29.816729 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-90501baa-a278-42cb-b92d-725f476770b7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:29.825605 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-90501baa-a278-42cb-b92d-725f476770b7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:29.827460 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-90501baa-a278-42cb-b92d-725f476770b7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:29.828611 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-90501baa-a278-42cb-b92d-725f476770b7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1749 microversion: 2.20 time: 0.156719 Oct 28 08:45:29.829157 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 468/933] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:29 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:30.029314 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-722c91ab-8f4e-4f70-85fb-4e4f1b295862 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:30.029921 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-722c91ab-8f4e-4f70-85fb-4e4f1b295862 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:30.036077 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-722c91ab-8f4e-4f70-85fb-4e4f1b295862 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:30.036077 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-722c91ab-8f4e-4f70-85fb-4e4f1b295862 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:30.036972 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-722c91ab-8f4e-4f70-85fb-4e4f1b295862 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:30.037400 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-722c91ab-8f4e-4f70-85fb-4e4f1b295862 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:30.167365 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-722c91ab-8f4e-4f70-85fb-4e4f1b295862 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:30.175279 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-722c91ab-8f4e-4f70-85fb-4e4f1b295862 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1260 microversion: 2.1 time: 0.150261 Oct 28 08:45:30.175855 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 466/934] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:30 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:30.847516 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-06a60323-22f8-4387-ac80-db0a59f70e2d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:30.848068 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-06a60323-22f8-4387-ac80-db0a59f70e2d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:30.854954 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06a60323-22f8-4387-ac80-db0a59f70e2d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:30.855472 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06a60323-22f8-4387-ac80-db0a59f70e2d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:30.856351 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06a60323-22f8-4387-ac80-db0a59f70e2d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:30.856782 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06a60323-22f8-4387-ac80-db0a59f70e2d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:30.989531 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-06a60323-22f8-4387-ac80-db0a59f70e2d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:30.998144 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-06a60323-22f8-4387-ac80-db0a59f70e2d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:30.999677 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-06a60323-22f8-4387-ac80-db0a59f70e2d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:31.000828 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-06a60323-22f8-4387-ac80-db0a59f70e2d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1751 microversion: 2.20 time: 0.157386 Oct 28 08:45:31.001394 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 469/935] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:30 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:31.192207 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0c843b24-bf2a-4706-862b-6e8ff504b146 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:31.192742 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0c843b24-bf2a-4706-862b-6e8ff504b146 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:31.198531 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c843b24-bf2a-4706-862b-6e8ff504b146 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:31.199000 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c843b24-bf2a-4706-862b-6e8ff504b146 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:31.199843 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c843b24-bf2a-4706-862b-6e8ff504b146 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:31.200271 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c843b24-bf2a-4706-862b-6e8ff504b146 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:31.322918 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-0c843b24-bf2a-4706-862b-6e8ff504b146 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:31.331337 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0c843b24-bf2a-4706-862b-6e8ff504b146 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1260 microversion: 2.1 time: 0.143130 Oct 28 08:45:31.331894 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 467/936] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:31 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1260 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:32.019818 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e7592057-75c9-4a14-aa00-546e512e233f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:32.020466 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e7592057-75c9-4a14-aa00-546e512e233f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:32.026419 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7592057-75c9-4a14-aa00-546e512e233f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:32.026896 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7592057-75c9-4a14-aa00-546e512e233f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:32.028288 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7592057-75c9-4a14-aa00-546e512e233f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:32.028723 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7592057-75c9-4a14-aa00-546e512e233f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:32.349126 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4f57ca5b-f485-4723-9857-acb9a2e01c01 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:32.349760 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4f57ca5b-f485-4723-9857-acb9a2e01c01 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:32.356200 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f57ca5b-f485-4723-9857-acb9a2e01c01 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:32.356651 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f57ca5b-f485-4723-9857-acb9a2e01c01 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:32.357436 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f57ca5b-f485-4723-9857-acb9a2e01c01 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:32.357866 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f57ca5b-f485-4723-9857-acb9a2e01c01 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:32.370780 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-e7592057-75c9-4a14-aa00-546e512e233f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:32.379877 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-e7592057-75c9-4a14-aa00-546e512e233f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:32.381372 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-e7592057-75c9-4a14-aa00-546e512e233f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:32.382546 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e7592057-75c9-4a14-aa00-546e512e233f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.366446 Oct 28 08:45:32.383140 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 470/937] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:32 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:32.486257 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-4f57ca5b-f485-4723-9857-acb9a2e01c01 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:32.493986 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4f57ca5b-f485-4723-9857-acb9a2e01c01 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1260 microversion: 2.1 time: 0.148485 Oct 28 08:45:32.494546 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 468/938] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:32 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:45:33.401303 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-df8c2d0a-77e1-4417-8440-4a1a753cb0b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:33.401887 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-df8c2d0a-77e1-4417-8440-4a1a753cb0b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:33.408886 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df8c2d0a-77e1-4417-8440-4a1a753cb0b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:33.409336 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df8c2d0a-77e1-4417-8440-4a1a753cb0b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:33.410107 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df8c2d0a-77e1-4417-8440-4a1a753cb0b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:33.410573 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df8c2d0a-77e1-4417-8440-4a1a753cb0b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:33.511493 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d287ac16-3a4d-471f-9832-b7289299714c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:33.521552 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d287ac16-3a4d-471f-9832-b7289299714c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:33.531392 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d287ac16-3a4d-471f-9832-b7289299714c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:33.547160 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d287ac16-3a4d-471f-9832-b7289299714c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:33.548201 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d287ac16-3a4d-471f-9832-b7289299714c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:33.548645 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d287ac16-3a4d-471f-9832-b7289299714c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:33.569009 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-df8c2d0a-77e1-4417-8440-4a1a753cb0b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:33.584195 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-df8c2d0a-77e1-4417-8440-4a1a753cb0b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:33.585922 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-df8c2d0a-77e1-4417-8440-4a1a753cb0b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:33.587175 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-df8c2d0a-77e1-4417-8440-4a1a753cb0b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.189524 Oct 28 08:45:33.587736 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 471/939] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:33 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:33.702322 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-d287ac16-3a4d-471f-9832-b7289299714c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:33.710335 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d287ac16-3a4d-471f-9832-b7289299714c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1260 microversion: 2.1 time: 0.202423 Oct 28 08:45:33.710928 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 469/940] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:33 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1260 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:45:34.606001 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5c640f17-45e7-45f8-98a5-8f80b5645456 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:34.606843 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5c640f17-45e7-45f8-98a5-8f80b5645456 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:34.613135 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c640f17-45e7-45f8-98a5-8f80b5645456 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:34.613579 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c640f17-45e7-45f8-98a5-8f80b5645456 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:34.614343 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c640f17-45e7-45f8-98a5-8f80b5645456 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:34.614802 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c640f17-45e7-45f8-98a5-8f80b5645456 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:34.726573 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2d6c15cf-1225-40d3-84df-24e84d5e9fe8 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:34.727283 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2d6c15cf-1225-40d3-84df-24e84d5e9fe8 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:34.733664 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d6c15cf-1225-40d3-84df-24e84d5e9fe8 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:34.734107 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d6c15cf-1225-40d3-84df-24e84d5e9fe8 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:34.734912 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d6c15cf-1225-40d3-84df-24e84d5e9fe8 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:34.735341 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d6c15cf-1225-40d3-84df-24e84d5e9fe8 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:34.743145 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-5c640f17-45e7-45f8-98a5-8f80b5645456 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:34.752294 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-5c640f17-45e7-45f8-98a5-8f80b5645456 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:34.753894 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-5c640f17-45e7-45f8-98a5-8f80b5645456 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:34.755240 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5c640f17-45e7-45f8-98a5-8f80b5645456 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.153509 Oct 28 08:45:34.758530 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 472/941] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:34 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:34.873819 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-2d6c15cf-1225-40d3-84df-24e84d5e9fe8 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:34.881437 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2d6c15cf-1225-40d3-84df-24e84d5e9fe8 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1260 microversion: 2.1 time: 0.158580 Oct 28 08:45:34.882074 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 470/942] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:34 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:35.772970 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c7d0f348-46d1-415a-bb37-79003a52613c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:35.773572 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c7d0f348-46d1-415a-bb37-79003a52613c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:35.779880 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7d0f348-46d1-415a-bb37-79003a52613c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:35.780319 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7d0f348-46d1-415a-bb37-79003a52613c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:35.781081 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7d0f348-46d1-415a-bb37-79003a52613c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:35.781508 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7d0f348-46d1-415a-bb37-79003a52613c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:35.899779 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c6369049-6820-4c40-bab1-dff4acca306f tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:35.901060 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c6369049-6820-4c40-bab1-dff4acca306f tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:35.908391 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6369049-6820-4c40-bab1-dff4acca306f tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:35.908841 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6369049-6820-4c40-bab1-dff4acca306f tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:35.909838 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6369049-6820-4c40-bab1-dff4acca306f tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:35.910278 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6369049-6820-4c40-bab1-dff4acca306f tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:35.916657 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-c7d0f348-46d1-415a-bb37-79003a52613c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:35.927110 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-c7d0f348-46d1-415a-bb37-79003a52613c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:35.928928 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-c7d0f348-46d1-415a-bb37-79003a52613c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:35.931384 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c7d0f348-46d1-415a-bb37-79003a52613c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.161266 Oct 28 08:45:35.932567 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 473/943] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:35 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:36.048453 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c6369049-6820-4c40-bab1-dff4acca306f tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:36.055906 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c6369049-6820-4c40-bab1-dff4acca306f tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1260 microversion: 2.1 time: 0.160247 Oct 28 08:45:36.056497 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 471/944] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:35 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:45:36.953346 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a7c0e63e-4f7a-45cf-8d7e-57fe2d50efbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:36.954177 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a7c0e63e-4f7a-45cf-8d7e-57fe2d50efbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:36.963872 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7c0e63e-4f7a-45cf-8d7e-57fe2d50efbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:36.964710 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7c0e63e-4f7a-45cf-8d7e-57fe2d50efbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:36.965777 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7c0e63e-4f7a-45cf-8d7e-57fe2d50efbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:36.966340 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7c0e63e-4f7a-45cf-8d7e-57fe2d50efbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:37.072732 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1bcc7e06-dc42-4961-9dc0-93ae8587d834 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:37.073331 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1bcc7e06-dc42-4961-9dc0-93ae8587d834 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:37.080956 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1bcc7e06-dc42-4961-9dc0-93ae8587d834 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:37.085279 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1bcc7e06-dc42-4961-9dc0-93ae8587d834 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:37.085856 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1bcc7e06-dc42-4961-9dc0-93ae8587d834 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:37.086272 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1bcc7e06-dc42-4961-9dc0-93ae8587d834 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:37.113431 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-a7c0e63e-4f7a-45cf-8d7e-57fe2d50efbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:37.123590 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-a7c0e63e-4f7a-45cf-8d7e-57fe2d50efbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:37.125091 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-a7c0e63e-4f7a-45cf-8d7e-57fe2d50efbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:37.126262 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a7c0e63e-4f7a-45cf-8d7e-57fe2d50efbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.178658 Oct 28 08:45:37.127042 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 474/945] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:36 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:37.234303 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-1bcc7e06-dc42-4961-9dc0-93ae8587d834 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:37.243485 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1bcc7e06-dc42-4961-9dc0-93ae8587d834 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1260 microversion: 2.1 time: 0.174215 Oct 28 08:45:37.244344 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 472/946] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:37 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:37.297292 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-54ba9497-e01a-48cc-9020-a365ef84ad7e req-cc1db9ab-69dd-4de3-84ea-f2b0329b23bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de3329c3-6608-4f3d-a14e-a1c563567ca1", "name": "network-vif-plugged", "status": "completed", "tag": "0740398f-07ce-4e13-b20f-5cf387cc8ba7"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:45:37.299517 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:45:37.299517 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:45:37.310760 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-54ba9497-e01a-48cc-9020-a365ef84ad7e req-cc1db9ab-69dd-4de3-84ea-f2b0329b23bc service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:37.311189 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-54ba9497-e01a-48cc-9020-a365ef84ad7e req-cc1db9ab-69dd-4de3-84ea-f2b0329b23bc service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:37.326484 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-54ba9497-e01a-48cc-9020-a365ef84ad7e req-cc1db9ab-69dd-4de3-84ea-f2b0329b23bc service nova] Creating event network-vif-plugged:0740398f-07ce-4e13-b20f-5cf387cc8ba7 for instance de3329c3-6608-4f3d-a14e-a1c563567ca1 on hv-cinder-81565 Oct 28 08:45:37.333068 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-54ba9497-e01a-48cc-9020-a365ef84ad7e req-cc1db9ab-69dd-4de3-84ea-f2b0329b23bc service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039774 Oct 28 08:45:37.333859 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 475/947] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:45:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:45:38.144123 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-99fdf336-d78d-4e1e-9288-9d88cb2601f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:38.144804 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-99fdf336-d78d-4e1e-9288-9d88cb2601f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:38.151266 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99fdf336-d78d-4e1e-9288-9d88cb2601f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:38.151794 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99fdf336-d78d-4e1e-9288-9d88cb2601f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:38.153293 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99fdf336-d78d-4e1e-9288-9d88cb2601f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:38.153798 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99fdf336-d78d-4e1e-9288-9d88cb2601f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:38.262688 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-620bc814-ff77-418c-a587-50f1f098f404 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:38.263407 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-620bc814-ff77-418c-a587-50f1f098f404 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:38.270569 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-620bc814-ff77-418c-a587-50f1f098f404 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:38.271010 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-620bc814-ff77-418c-a587-50f1f098f404 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:38.271784 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-620bc814-ff77-418c-a587-50f1f098f404 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:38.272210 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-620bc814-ff77-418c-a587-50f1f098f404 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:38.286314 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-99fdf336-d78d-4e1e-9288-9d88cb2601f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:38.295154 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-99fdf336-d78d-4e1e-9288-9d88cb2601f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:38.296653 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-99fdf336-d78d-4e1e-9288-9d88cb2601f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:38.297974 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-99fdf336-d78d-4e1e-9288-9d88cb2601f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.157549 Oct 28 08:45:38.298839 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 473/948] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:38 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:38.407258 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-620bc814-ff77-418c-a587-50f1f098f404 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:38.414783 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-620bc814-ff77-418c-a587-50f1f098f404 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1260 microversion: 2.1 time: 0.157420 Oct 28 08:45:38.415352 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 476/949] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:38 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:45:39.318113 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3c2c648a-a660-4cce-95b5-a0a7bb926f13 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:39.318768 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3c2c648a-a660-4cce-95b5-a0a7bb926f13 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:39.326978 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c2c648a-a660-4cce-95b5-a0a7bb926f13 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:39.327419 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c2c648a-a660-4cce-95b5-a0a7bb926f13 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:39.328191 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c2c648a-a660-4cce-95b5-a0a7bb926f13 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:39.328615 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c2c648a-a660-4cce-95b5-a0a7bb926f13 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:39.432985 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-97240eff-e6aa-4547-a537-7afa00f8dfd2 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:39.435154 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-97240eff-e6aa-4547-a537-7afa00f8dfd2 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:39.442982 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97240eff-e6aa-4547-a537-7afa00f8dfd2 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:39.443483 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97240eff-e6aa-4547-a537-7afa00f8dfd2 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:39.444152 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97240eff-e6aa-4547-a537-7afa00f8dfd2 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:39.444606 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97240eff-e6aa-4547-a537-7afa00f8dfd2 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:39.456870 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-3c2c648a-a660-4cce-95b5-a0a7bb926f13 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:39.466063 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-3c2c648a-a660-4cce-95b5-a0a7bb926f13 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:39.467766 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-3c2c648a-a660-4cce-95b5-a0a7bb926f13 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:39.469294 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3c2c648a-a660-4cce-95b5-a0a7bb926f13 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.154794 Oct 28 08:45:39.475248 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 474/950] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:39 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:39.576789 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-97240eff-e6aa-4547-a537-7afa00f8dfd2 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:39.584390 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-97240eff-e6aa-4547-a537-7afa00f8dfd2 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1260 microversion: 2.1 time: 0.154963 Oct 28 08:45:39.584958 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 477/951] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:39 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:45:40.488061 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3265a578-811f-4980-b8c5-44f927ccaf6d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:40.489318 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3265a578-811f-4980-b8c5-44f927ccaf6d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:40.497263 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3265a578-811f-4980-b8c5-44f927ccaf6d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:40.497809 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3265a578-811f-4980-b8c5-44f927ccaf6d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:40.498712 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3265a578-811f-4980-b8c5-44f927ccaf6d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:40.499388 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3265a578-811f-4980-b8c5-44f927ccaf6d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:40.602211 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6c7988eb-271b-4b01-9654-cb4f7f2ed35c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:40.602857 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6c7988eb-271b-4b01-9654-cb4f7f2ed35c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:40.609829 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c7988eb-271b-4b01-9654-cb4f7f2ed35c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:40.610272 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c7988eb-271b-4b01-9654-cb4f7f2ed35c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:40.611081 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c7988eb-271b-4b01-9654-cb4f7f2ed35c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:40.611516 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c7988eb-271b-4b01-9654-cb4f7f2ed35c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:40.637222 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-3265a578-811f-4980-b8c5-44f927ccaf6d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:40.643328 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-3265a578-811f-4980-b8c5-44f927ccaf6d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:40.644979 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-3265a578-811f-4980-b8c5-44f927ccaf6d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:40.646262 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3265a578-811f-4980-b8c5-44f927ccaf6d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.162289 Oct 28 08:45:40.647260 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 475/952] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:40 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:40.746377 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-6c7988eb-271b-4b01-9654-cb4f7f2ed35c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:40.753764 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6c7988eb-271b-4b01-9654-cb4f7f2ed35c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1260 microversion: 2.1 time: 0.155339 Oct 28 08:45:40.754343 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 478/953] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:40 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:41.666693 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3fba4abf-8bee-4ee2-ac2a-fe9a9c5ba2f1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:41.668647 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3fba4abf-8bee-4ee2-ac2a-fe9a9c5ba2f1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:41.676690 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fba4abf-8bee-4ee2-ac2a-fe9a9c5ba2f1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:41.677136 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fba4abf-8bee-4ee2-ac2a-fe9a9c5ba2f1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:41.677974 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fba4abf-8bee-4ee2-ac2a-fe9a9c5ba2f1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:41.678757 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fba4abf-8bee-4ee2-ac2a-fe9a9c5ba2f1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:41.771482 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b5eeb824-9510-4b0a-b149-f0535fc8e32d tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:41.772379 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b5eeb824-9510-4b0a-b149-f0535fc8e32d tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:41.779200 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5eeb824-9510-4b0a-b149-f0535fc8e32d tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:41.779831 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5eeb824-9510-4b0a-b149-f0535fc8e32d tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:41.780677 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5eeb824-9510-4b0a-b149-f0535fc8e32d tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:41.781109 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5eeb824-9510-4b0a-b149-f0535fc8e32d tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:41.820798 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-3fba4abf-8bee-4ee2-ac2a-fe9a9c5ba2f1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:41.831799 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-3fba4abf-8bee-4ee2-ac2a-fe9a9c5ba2f1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:41.833333 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-3fba4abf-8bee-4ee2-ac2a-fe9a9c5ba2f1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:41.834520 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3fba4abf-8bee-4ee2-ac2a-fe9a9c5ba2f1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.172470 Oct 28 08:45:41.835322 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 476/954] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:41 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:45:41.932686 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-b5eeb824-9510-4b0a-b149-f0535fc8e32d tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:41.941124 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b5eeb824-9510-4b0a-b149-f0535fc8e32d tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1260 microversion: 2.1 time: 0.173833 Oct 28 08:45:41.942546 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 479/955] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:41 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:45:42.854560 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-318ea57f-1038-4531-96e7-0a8d98317e30 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:42.857340 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-318ea57f-1038-4531-96e7-0a8d98317e30 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:42.865485 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-318ea57f-1038-4531-96e7-0a8d98317e30 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:42.866088 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-318ea57f-1038-4531-96e7-0a8d98317e30 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:42.867102 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-318ea57f-1038-4531-96e7-0a8d98317e30 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:42.867472 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-318ea57f-1038-4531-96e7-0a8d98317e30 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:42.957817 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9977e10b-4ede-4766-892a-966ed3886815 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:42.958212 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9977e10b-4ede-4766-892a-966ed3886815 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:42.966334 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9977e10b-4ede-4766-892a-966ed3886815 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:42.966887 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9977e10b-4ede-4766-892a-966ed3886815 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:42.967717 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9977e10b-4ede-4766-892a-966ed3886815 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:42.968137 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9977e10b-4ede-4766-892a-966ed3886815 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:43.002153 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-318ea57f-1038-4531-96e7-0a8d98317e30 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:43.011638 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-318ea57f-1038-4531-96e7-0a8d98317e30 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:43.013285 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-318ea57f-1038-4531-96e7-0a8d98317e30 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:43.014579 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-318ea57f-1038-4531-96e7-0a8d98317e30 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.165293 Oct 28 08:45:43.027033 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 477/956] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:42 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:43.094458 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-9977e10b-4ede-4766-892a-966ed3886815 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:43.102463 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9977e10b-4ede-4766-892a-966ed3886815 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1260 microversion: 2.1 time: 0.148578 Oct 28 08:45:43.103072 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 480/957] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:42 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:44.035029 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-92fb05e3-79ec-4e49-bbd0-f02bbc4e146a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:44.035725 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-92fb05e3-79ec-4e49-bbd0-f02bbc4e146a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:44.043100 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92fb05e3-79ec-4e49-bbd0-f02bbc4e146a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:44.043649 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92fb05e3-79ec-4e49-bbd0-f02bbc4e146a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:44.044445 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92fb05e3-79ec-4e49-bbd0-f02bbc4e146a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:44.044893 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92fb05e3-79ec-4e49-bbd0-f02bbc4e146a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:44.120226 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a2bf4cff-db0b-44d4-bdb2-e6692cf00233 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:44.120894 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a2bf4cff-db0b-44d4-bdb2-e6692cf00233 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:44.127163 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2bf4cff-db0b-44d4-bdb2-e6692cf00233 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:44.127676 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2bf4cff-db0b-44d4-bdb2-e6692cf00233 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:44.128539 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2bf4cff-db0b-44d4-bdb2-e6692cf00233 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:44.128963 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2bf4cff-db0b-44d4-bdb2-e6692cf00233 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:44.200059 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-92fb05e3-79ec-4e49-bbd0-f02bbc4e146a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:44.209749 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-92fb05e3-79ec-4e49-bbd0-f02bbc4e146a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:44.211427 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-92fb05e3-79ec-4e49-bbd0-f02bbc4e146a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:44.212646 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-92fb05e3-79ec-4e49-bbd0-f02bbc4e146a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.182017 Oct 28 08:45:44.213213 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 478/958] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:44 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:44.279907 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-a2bf4cff-db0b-44d4-bdb2-e6692cf00233 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:44.289308 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a2bf4cff-db0b-44d4-bdb2-e6692cf00233 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1260 microversion: 2.1 time: 0.172527 Oct 28 08:45:44.290678 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 481/959] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:44 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:45:45.231997 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8f233112-5da6-4238-a5c8-a3c23aa654d8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:45.232613 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8f233112-5da6-4238-a5c8-a3c23aa654d8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:45.239108 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f233112-5da6-4238-a5c8-a3c23aa654d8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:45.239557 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f233112-5da6-4238-a5c8-a3c23aa654d8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:45.240323 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f233112-5da6-4238-a5c8-a3c23aa654d8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:45.240757 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f233112-5da6-4238-a5c8-a3c23aa654d8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:45.308207 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2d54a8a9-5f23-408c-ba2a-32291b7e2231 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:45.309458 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2d54a8a9-5f23-408c-ba2a-32291b7e2231 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:45.316958 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d54a8a9-5f23-408c-ba2a-32291b7e2231 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:45.317470 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d54a8a9-5f23-408c-ba2a-32291b7e2231 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:45.318367 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d54a8a9-5f23-408c-ba2a-32291b7e2231 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:45.318899 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d54a8a9-5f23-408c-ba2a-32291b7e2231 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:45.375362 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-8f233112-5da6-4238-a5c8-a3c23aa654d8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:45.383769 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-8f233112-5da6-4238-a5c8-a3c23aa654d8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:45.385340 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-8f233112-5da6-4238-a5c8-a3c23aa654d8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:45.386782 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8f233112-5da6-4238-a5c8-a3c23aa654d8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.159081 Oct 28 08:45:45.387908 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 479/960] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:45 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:45.454291 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-2d54a8a9-5f23-408c-ba2a-32291b7e2231 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:45.461480 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2d54a8a9-5f23-408c-ba2a-32291b7e2231 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1260 microversion: 2.1 time: 0.157372 Oct 28 08:45:45.462043 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 482/961] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:45 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:45:46.406192 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4d992cb8-0a4d-4beb-8143-8cf0a4fc175c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:46.406796 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4d992cb8-0a4d-4beb-8143-8cf0a4fc175c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:46.413267 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d992cb8-0a4d-4beb-8143-8cf0a4fc175c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:46.413745 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d992cb8-0a4d-4beb-8143-8cf0a4fc175c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:46.414538 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d992cb8-0a4d-4beb-8143-8cf0a4fc175c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:46.414974 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d992cb8-0a4d-4beb-8143-8cf0a4fc175c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:46.479074 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-70e9db43-895f-43a4-b2a0-636b4f7d8793 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:46.479675 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-70e9db43-895f-43a4-b2a0-636b4f7d8793 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:46.486563 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70e9db43-895f-43a4-b2a0-636b4f7d8793 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:46.487064 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70e9db43-895f-43a4-b2a0-636b4f7d8793 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:46.487772 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70e9db43-895f-43a4-b2a0-636b4f7d8793 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:46.488202 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70e9db43-895f-43a4-b2a0-636b4f7d8793 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:46.566232 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-4d992cb8-0a4d-4beb-8143-8cf0a4fc175c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:46.574568 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-4d992cb8-0a4d-4beb-8143-8cf0a4fc175c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:46.576157 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-4d992cb8-0a4d-4beb-8143-8cf0a4fc175c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:46.577314 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4d992cb8-0a4d-4beb-8143-8cf0a4fc175c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.175667 Oct 28 08:45:46.577876 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 480/962] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:46 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:46.625279 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-70e9db43-895f-43a4-b2a0-636b4f7d8793 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:46.632640 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-70e9db43-895f-43a4-b2a0-636b4f7d8793 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1260 microversion: 2.1 time: 0.157291 Oct 28 08:45:46.633226 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 483/963] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:46 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:45:47.596968 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-449118cc-9683-43ee-b6e3-3849f868acbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:47.597563 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-449118cc-9683-43ee-b6e3-3849f868acbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:47.604363 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-449118cc-9683-43ee-b6e3-3849f868acbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:47.604810 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-449118cc-9683-43ee-b6e3-3849f868acbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:47.606120 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-449118cc-9683-43ee-b6e3-3849f868acbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:47.606578 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-449118cc-9683-43ee-b6e3-3849f868acbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:47.648850 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-11583908-da31-4f87-ae1c-1f5f176277e4 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:47.649451 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-11583908-da31-4f87-ae1c-1f5f176277e4 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:47.660299 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11583908-da31-4f87-ae1c-1f5f176277e4 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:47.660740 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11583908-da31-4f87-ae1c-1f5f176277e4 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:47.661524 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11583908-da31-4f87-ae1c-1f5f176277e4 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:47.661943 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11583908-da31-4f87-ae1c-1f5f176277e4 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:47.760180 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-449118cc-9683-43ee-b6e3-3849f868acbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:47.769681 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-449118cc-9683-43ee-b6e3-3849f868acbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:47.771270 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-449118cc-9683-43ee-b6e3-3849f868acbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:47.772516 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-449118cc-9683-43ee-b6e3-3849f868acbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.179570 Oct 28 08:45:47.773115 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 481/964] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:47 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:45:47.811895 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-11583908-da31-4f87-ae1c-1f5f176277e4 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:47.819241 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-11583908-da31-4f87-ae1c-1f5f176277e4 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1260 microversion: 2.1 time: 0.174006 Oct 28 08:45:47.819810 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 484/965] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:47 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:48.791335 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aa0bbdb0-dfc4-4468-8b52-7c69e1eed1e3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:48.791957 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-aa0bbdb0-dfc4-4468-8b52-7c69e1eed1e3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:48.798963 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa0bbdb0-dfc4-4468-8b52-7c69e1eed1e3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:48.799410 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa0bbdb0-dfc4-4468-8b52-7c69e1eed1e3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:48.800179 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa0bbdb0-dfc4-4468-8b52-7c69e1eed1e3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:48.800610 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa0bbdb0-dfc4-4468-8b52-7c69e1eed1e3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:48.835981 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f0f3d215-05ee-472d-b360-1b0b81e466af tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:48.836579 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f0f3d215-05ee-472d-b360-1b0b81e466af tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:48.843684 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0f3d215-05ee-472d-b360-1b0b81e466af tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:48.844119 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0f3d215-05ee-472d-b360-1b0b81e466af tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:48.844890 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0f3d215-05ee-472d-b360-1b0b81e466af tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:48.845318 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0f3d215-05ee-472d-b360-1b0b81e466af tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:48.961009 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-aa0bbdb0-dfc4-4468-8b52-7c69e1eed1e3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:48.971859 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-aa0bbdb0-dfc4-4468-8b52-7c69e1eed1e3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:48.973453 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-aa0bbdb0-dfc4-4468-8b52-7c69e1eed1e3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:48.974734 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-aa0bbdb0-dfc4-4468-8b52-7c69e1eed1e3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.187157 Oct 28 08:45:48.975940 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 482/966] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:48 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:49.012471 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-f0f3d215-05ee-472d-b360-1b0b81e466af tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:49.020188 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f0f3d215-05ee-472d-b360-1b0b81e466af tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1260 microversion: 2.1 time: 0.187761 Oct 28 08:45:49.020748 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 485/967] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:48 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:45:49.993355 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5f96f961-c9fa-48d5-a742-e9f35ef4f883 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:49.993963 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5f96f961-c9fa-48d5-a742-e9f35ef4f883 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:50.000915 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f96f961-c9fa-48d5-a742-e9f35ef4f883 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:50.001363 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f96f961-c9fa-48d5-a742-e9f35ef4f883 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:50.002133 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f96f961-c9fa-48d5-a742-e9f35ef4f883 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:50.002587 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f96f961-c9fa-48d5-a742-e9f35ef4f883 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:50.036780 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4695d23a-dd2f-4686-b914-ad58088f3e0c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:50.037522 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4695d23a-dd2f-4686-b914-ad58088f3e0c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:50.045393 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4695d23a-dd2f-4686-b914-ad58088f3e0c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:50.046370 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4695d23a-dd2f-4686-b914-ad58088f3e0c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:50.047837 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4695d23a-dd2f-4686-b914-ad58088f3e0c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:50.048269 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4695d23a-dd2f-4686-b914-ad58088f3e0c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:50.160540 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-5f96f961-c9fa-48d5-a742-e9f35ef4f883 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:50.171364 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-5f96f961-c9fa-48d5-a742-e9f35ef4f883 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:50.172878 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-5f96f961-c9fa-48d5-a742-e9f35ef4f883 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:50.174050 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5f96f961-c9fa-48d5-a742-e9f35ef4f883 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.184443 Oct 28 08:45:50.174624 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 483/968] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:49 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:50.214076 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-4695d23a-dd2f-4686-b914-ad58088f3e0c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:50.222232 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4695d23a-dd2f-4686-b914-ad58088f3e0c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1260 microversion: 2.1 time: 0.189096 Oct 28 08:45:50.222839 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 486/969] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:50 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:51.192834 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a6d5c334-0f83-4625-a717-c8ac8ecdcd47 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:51.193355 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a6d5c334-0f83-4625-a717-c8ac8ecdcd47 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:51.200244 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6d5c334-0f83-4625-a717-c8ac8ecdcd47 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:51.200693 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6d5c334-0f83-4625-a717-c8ac8ecdcd47 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:51.201458 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6d5c334-0f83-4625-a717-c8ac8ecdcd47 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:51.201890 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6d5c334-0f83-4625-a717-c8ac8ecdcd47 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:51.238838 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b356ddd7-ab78-4e39-8c51-de41c60df1b7 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:51.239547 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b356ddd7-ab78-4e39-8c51-de41c60df1b7 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:51.246417 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b356ddd7-ab78-4e39-8c51-de41c60df1b7 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:51.246968 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b356ddd7-ab78-4e39-8c51-de41c60df1b7 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:51.247846 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b356ddd7-ab78-4e39-8c51-de41c60df1b7 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:51.248268 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b356ddd7-ab78-4e39-8c51-de41c60df1b7 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:51.352453 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-a6d5c334-0f83-4625-a717-c8ac8ecdcd47 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:51.360784 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-a6d5c334-0f83-4625-a717-c8ac8ecdcd47 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:51.362261 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-a6d5c334-0f83-4625-a717-c8ac8ecdcd47 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:51.363451 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a6d5c334-0f83-4625-a717-c8ac8ecdcd47 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.174383 Oct 28 08:45:51.364361 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 484/970] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:51 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:51.410912 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-b356ddd7-ab78-4e39-8c51-de41c60df1b7 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:51.420287 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b356ddd7-ab78-4e39-8c51-de41c60df1b7 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1260 microversion: 2.1 time: 0.184989 Oct 28 08:45:51.420869 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 487/971] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:51 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:45:52.382046 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2bbe1041-c373-4d16-90ce-cbb9ff34efd8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:52.382636 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2bbe1041-c373-4d16-90ce-cbb9ff34efd8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:52.390196 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2bbe1041-c373-4d16-90ce-cbb9ff34efd8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:52.390725 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2bbe1041-c373-4d16-90ce-cbb9ff34efd8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:52.391535 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2bbe1041-c373-4d16-90ce-cbb9ff34efd8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:52.391969 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2bbe1041-c373-4d16-90ce-cbb9ff34efd8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:52.437328 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4c56086e-c7cf-44f6-85b3-f39e6ed59a14 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:52.438110 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4c56086e-c7cf-44f6-85b3-f39e6ed59a14 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:52.444646 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c56086e-c7cf-44f6-85b3-f39e6ed59a14 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:52.445272 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c56086e-c7cf-44f6-85b3-f39e6ed59a14 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:52.446095 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c56086e-c7cf-44f6-85b3-f39e6ed59a14 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:52.446560 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c56086e-c7cf-44f6-85b3-f39e6ed59a14 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:52.556218 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-2bbe1041-c373-4d16-90ce-cbb9ff34efd8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:52.567371 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-2bbe1041-c373-4d16-90ce-cbb9ff34efd8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:52.569447 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-2bbe1041-c373-4d16-90ce-cbb9ff34efd8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:52.570628 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2bbe1041-c373-4d16-90ce-cbb9ff34efd8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.192422 Oct 28 08:45:52.571242 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 485/972] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:52 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:52.609832 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-4c56086e-c7cf-44f6-85b3-f39e6ed59a14 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:52.617223 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4c56086e-c7cf-44f6-85b3-f39e6ed59a14 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1260 microversion: 2.1 time: 0.183644 Oct 28 08:45:52.617797 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 488/973] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:52 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:45:53.590696 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8baed524-331f-493d-ae83-5451b12d7037 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:53.591357 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8baed524-331f-493d-ae83-5451b12d7037 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:53.597714 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8baed524-331f-493d-ae83-5451b12d7037 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:53.598162 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8baed524-331f-493d-ae83-5451b12d7037 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:53.598971 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8baed524-331f-493d-ae83-5451b12d7037 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:53.599408 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8baed524-331f-493d-ae83-5451b12d7037 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:53.633828 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-efce0a58-ccab-494d-97c9-b8241ea4e514 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:53.634444 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-efce0a58-ccab-494d-97c9-b8241ea4e514 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:53.640517 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efce0a58-ccab-494d-97c9-b8241ea4e514 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:53.640975 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efce0a58-ccab-494d-97c9-b8241ea4e514 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:53.641743 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efce0a58-ccab-494d-97c9-b8241ea4e514 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:53.642176 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efce0a58-ccab-494d-97c9-b8241ea4e514 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:53.802452 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-8baed524-331f-493d-ae83-5451b12d7037 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:53.812083 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-8baed524-331f-493d-ae83-5451b12d7037 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:53.814109 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-8baed524-331f-493d-ae83-5451b12d7037 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:53.815408 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8baed524-331f-493d-ae83-5451b12d7037 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.229076 Oct 28 08:45:53.816055 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 486/974] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:53 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:53.863013 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-efce0a58-ccab-494d-97c9-b8241ea4e514 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:53.870339 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-efce0a58-ccab-494d-97c9-b8241ea4e514 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1260 microversion: 2.1 time: 0.239966 Oct 28 08:45:53.870855 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 489/975] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:53 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1260 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:45:54.834184 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0c8058b1-7c19-4cbb-b0cc-06c26a7d4bd4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:54.836029 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0c8058b1-7c19-4cbb-b0cc-06c26a7d4bd4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:54.842460 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c8058b1-7c19-4cbb-b0cc-06c26a7d4bd4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:54.842928 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c8058b1-7c19-4cbb-b0cc-06c26a7d4bd4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:54.843948 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c8058b1-7c19-4cbb-b0cc-06c26a7d4bd4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:54.844369 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c8058b1-7c19-4cbb-b0cc-06c26a7d4bd4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:54.886572 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6deef198-6cb7-49ba-8d59-7c717d09085d tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:54.887860 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6deef198-6cb7-49ba-8d59-7c717d09085d tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:54.894408 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6deef198-6cb7-49ba-8d59-7c717d09085d tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:54.895227 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6deef198-6cb7-49ba-8d59-7c717d09085d tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:54.896072 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6deef198-6cb7-49ba-8d59-7c717d09085d tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:54.896702 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6deef198-6cb7-49ba-8d59-7c717d09085d tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:55.014137 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-0c8058b1-7c19-4cbb-b0cc-06c26a7d4bd4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:55.025444 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-0c8058b1-7c19-4cbb-b0cc-06c26a7d4bd4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:55.028205 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-0c8058b1-7c19-4cbb-b0cc-06c26a7d4bd4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:55.029170 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0c8058b1-7c19-4cbb-b0cc-06c26a7d4bd4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.199360 Oct 28 08:45:55.034174 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 487/976] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:54 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:55.077181 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-6deef198-6cb7-49ba-8d59-7c717d09085d tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:55.085702 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6deef198-6cb7-49ba-8d59-7c717d09085d tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1445 microversion: 2.1 time: 0.202729 Oct 28 08:45:55.086378 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 490/977] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:54 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1445 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:45:55.107644 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1d325521-aab4-4ab2-9f46-59023f22798e tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:55.108329 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1d325521-aab4-4ab2-9f46-59023f22798e tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:55.117041 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d325521-aab4-4ab2-9f46-59023f22798e tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:55.117893 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d325521-aab4-4ab2-9f46-59023f22798e tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:55.119362 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d325521-aab4-4ab2-9f46-59023f22798e tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:55.120638 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d325521-aab4-4ab2-9f46-59023f22798e tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:55.319234 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-1d325521-aab4-4ab2-9f46-59023f22798e tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:55.327291 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1d325521-aab4-4ab2-9f46-59023f22798e tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1445 microversion: 2.1 time: 0.227650 Oct 28 08:45:55.328104 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 488/978] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:45:55 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1445 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:45:56.048254 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-45b4ae97-2731-4f46-9258-73dc266dac1a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:56.050679 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-45b4ae97-2731-4f46-9258-73dc266dac1a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:56.057831 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45b4ae97-2731-4f46-9258-73dc266dac1a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:56.059061 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45b4ae97-2731-4f46-9258-73dc266dac1a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:56.060212 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45b4ae97-2731-4f46-9258-73dc266dac1a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:56.060783 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45b4ae97-2731-4f46-9258-73dc266dac1a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:56.370572 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-45b4ae97-2731-4f46-9258-73dc266dac1a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:56.380698 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-45b4ae97-2731-4f46-9258-73dc266dac1a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:56.382463 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-45b4ae97-2731-4f46-9258-73dc266dac1a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:56.383698 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-45b4ae97-2731-4f46-9258-73dc266dac1a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.339105 Oct 28 08:45:56.384365 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 491/979] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:56 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:57.403277 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eb366cec-0f03-4513-86df-d7c2b6e482ac tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:57.404560 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eb366cec-0f03-4513-86df-d7c2b6e482ac tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:57.411135 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb366cec-0f03-4513-86df-d7c2b6e482ac tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:57.412167 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb366cec-0f03-4513-86df-d7c2b6e482ac tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:57.413174 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb366cec-0f03-4513-86df-d7c2b6e482ac tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:57.413815 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb366cec-0f03-4513-86df-d7c2b6e482ac tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:57.416388 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-8431b80e-73e2-4e6d-bd60-ee625ecf6297 req-65b435de-4f7c-41de-af47-06f64b3ca6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de3329c3-6608-4f3d-a14e-a1c563567ca1", "tag": "0740398f-07ce-4e13-b20f-5cf387cc8ba7"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:45:57.419654 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:45:57.419654 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:45:57.426678 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8431b80e-73e2-4e6d-bd60-ee625ecf6297 req-65b435de-4f7c-41de-af47-06f64b3ca6e5 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:57.427112 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8431b80e-73e2-4e6d-bd60-ee625ecf6297 req-65b435de-4f7c-41de-af47-06f64b3ca6e5 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:57.439652 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-8431b80e-73e2-4e6d-bd60-ee625ecf6297 req-65b435de-4f7c-41de-af47-06f64b3ca6e5 service nova] Creating event network-changed:0740398f-07ce-4e13-b20f-5cf387cc8ba7 for instance de3329c3-6608-4f3d-a14e-a1c563567ca1 on hv-cinder-81565 Oct 28 08:45:57.444798 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-8431b80e-73e2-4e6d-bd60-ee625ecf6297 req-65b435de-4f7c-41de-af47-06f64b3ca6e5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184233 Oct 28 08:45:57.445594 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 489/980] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:45:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:45:57.652382 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-eb366cec-0f03-4513-86df-d7c2b6e482ac tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:57.667924 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-eb366cec-0f03-4513-86df-d7c2b6e482ac tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:57.669976 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-eb366cec-0f03-4513-86df-d7c2b6e482ac tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:57.671905 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eb366cec-0f03-4513-86df-d7c2b6e482ac tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.272915 Oct 28 08:45:57.672860 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 492/981] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:57 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:45:58.690364 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d4ca03c7-107c-4b0b-bd7d-cfc0bd37a8b4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:58.691159 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d4ca03c7-107c-4b0b-bd7d-cfc0bd37a8b4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:58.698801 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4ca03c7-107c-4b0b-bd7d-cfc0bd37a8b4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:58.699251 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4ca03c7-107c-4b0b-bd7d-cfc0bd37a8b4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:58.700306 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4ca03c7-107c-4b0b-bd7d-cfc0bd37a8b4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:58.700837 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4ca03c7-107c-4b0b-bd7d-cfc0bd37a8b4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:58.836979 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-d4ca03c7-107c-4b0b-bd7d-cfc0bd37a8b4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:58.846201 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-d4ca03c7-107c-4b0b-bd7d-cfc0bd37a8b4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:58.847743 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-d4ca03c7-107c-4b0b-bd7d-cfc0bd37a8b4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:45:58.849025 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d4ca03c7-107c-4b0b-bd7d-cfc0bd37a8b4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.163366 Oct 28 08:45:58.849613 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 490/982] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:58 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:45:59.867184 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7be334a0-8a41-419e-93f2-ea634b6a70aa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:45:59.867783 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7be334a0-8a41-419e-93f2-ea634b6a70aa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:45:59.874998 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7be334a0-8a41-419e-93f2-ea634b6a70aa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:59.875461 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7be334a0-8a41-419e-93f2-ea634b6a70aa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:59.876211 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7be334a0-8a41-419e-93f2-ea634b6a70aa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:45:59.876642 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7be334a0-8a41-419e-93f2-ea634b6a70aa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:45:59.998294 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-7be334a0-8a41-419e-93f2-ea634b6a70aa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:00.006830 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-7be334a0-8a41-419e-93f2-ea634b6a70aa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:00.008326 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-7be334a0-8a41-419e-93f2-ea634b6a70aa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:00.009473 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7be334a0-8a41-419e-93f2-ea634b6a70aa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.146142 Oct 28 08:46:00.010029 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 493/983] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:45:59 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:01.027733 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-04e9aa6e-dfed-434b-9d98-688692a2b873 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:01.028300 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-04e9aa6e-dfed-434b-9d98-688692a2b873 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:01.036579 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04e9aa6e-dfed-434b-9d98-688692a2b873 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:01.037027 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04e9aa6e-dfed-434b-9d98-688692a2b873 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:01.037805 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04e9aa6e-dfed-434b-9d98-688692a2b873 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:01.038240 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04e9aa6e-dfed-434b-9d98-688692a2b873 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:01.165343 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-04e9aa6e-dfed-434b-9d98-688692a2b873 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:01.174438 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-04e9aa6e-dfed-434b-9d98-688692a2b873 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:01.175956 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-04e9aa6e-dfed-434b-9d98-688692a2b873 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:01.177088 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-04e9aa6e-dfed-434b-9d98-688692a2b873 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.154195 Oct 28 08:46:01.177644 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 491/984] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:01 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:02.195547 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b35dad84-2afc-48ba-b433-b55d930da4cb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:02.196155 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b35dad84-2afc-48ba-b433-b55d930da4cb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:02.202058 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b35dad84-2afc-48ba-b433-b55d930da4cb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:02.202538 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b35dad84-2afc-48ba-b433-b55d930da4cb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:02.203306 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b35dad84-2afc-48ba-b433-b55d930da4cb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:02.203769 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b35dad84-2afc-48ba-b433-b55d930da4cb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:02.327783 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-b35dad84-2afc-48ba-b433-b55d930da4cb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:02.335977 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-b35dad84-2afc-48ba-b433-b55d930da4cb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:02.337475 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-b35dad84-2afc-48ba-b433-b55d930da4cb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:02.338658 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b35dad84-2afc-48ba-b433-b55d930da4cb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.146955 Oct 28 08:46:02.339214 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 494/985] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:02 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:03.356850 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2a17af3a-6b7d-4077-bc27-adb76d097d0c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:03.357448 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2a17af3a-6b7d-4077-bc27-adb76d097d0c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:03.364075 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a17af3a-6b7d-4077-bc27-adb76d097d0c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:03.364547 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a17af3a-6b7d-4077-bc27-adb76d097d0c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:03.365331 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a17af3a-6b7d-4077-bc27-adb76d097d0c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:03.365751 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a17af3a-6b7d-4077-bc27-adb76d097d0c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:03.489425 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-2a17af3a-6b7d-4077-bc27-adb76d097d0c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:03.498610 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-2a17af3a-6b7d-4077-bc27-adb76d097d0c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:03.500116 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-2a17af3a-6b7d-4077-bc27-adb76d097d0c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:03.501252 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2a17af3a-6b7d-4077-bc27-adb76d097d0c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.148193 Oct 28 08:46:03.501805 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 492/986] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:03 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:04.519140 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-296bd816-707f-401f-a101-195985f4dc2c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:04.519721 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-296bd816-707f-401f-a101-195985f4dc2c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:04.525791 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-296bd816-707f-401f-a101-195985f4dc2c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:04.526347 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-296bd816-707f-401f-a101-195985f4dc2c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:04.527766 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-296bd816-707f-401f-a101-195985f4dc2c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:04.528190 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-296bd816-707f-401f-a101-195985f4dc2c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:04.652166 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-296bd816-707f-401f-a101-195985f4dc2c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:04.660373 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-296bd816-707f-401f-a101-195985f4dc2c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:04.661860 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-296bd816-707f-401f-a101-195985f4dc2c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:04.663074 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-296bd816-707f-401f-a101-195985f4dc2c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.147664 Oct 28 08:46:04.663628 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 495/987] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:04 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:05.683611 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5bd27416-7ac9-495e-acc9-c6a417fe8837 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:05.684254 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5bd27416-7ac9-495e-acc9-c6a417fe8837 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:05.690776 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bd27416-7ac9-495e-acc9-c6a417fe8837 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:05.691240 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bd27416-7ac9-495e-acc9-c6a417fe8837 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:05.692031 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bd27416-7ac9-495e-acc9-c6a417fe8837 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:05.692463 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bd27416-7ac9-495e-acc9-c6a417fe8837 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:05.827030 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-5bd27416-7ac9-495e-acc9-c6a417fe8837 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:05.835862 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-5bd27416-7ac9-495e-acc9-c6a417fe8837 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:05.837401 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-5bd27416-7ac9-495e-acc9-c6a417fe8837 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:05.838986 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5bd27416-7ac9-495e-acc9-c6a417fe8837 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.159908 Oct 28 08:46:05.839552 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 493/988] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:05 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:06.857132 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5c722c55-94ac-479b-98d7-da68e3b650e4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:06.857735 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5c722c55-94ac-479b-98d7-da68e3b650e4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:06.864031 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c722c55-94ac-479b-98d7-da68e3b650e4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:06.864472 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c722c55-94ac-479b-98d7-da68e3b650e4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:06.865240 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c722c55-94ac-479b-98d7-da68e3b650e4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:06.866064 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c722c55-94ac-479b-98d7-da68e3b650e4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:07.042756 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-5c722c55-94ac-479b-98d7-da68e3b650e4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:07.053465 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-5c722c55-94ac-479b-98d7-da68e3b650e4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:07.055026 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-5c722c55-94ac-479b-98d7-da68e3b650e4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:07.056209 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5c722c55-94ac-479b-98d7-da68e3b650e4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.203064 Oct 28 08:46:07.056773 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 496/989] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:06 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:07.563434 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-76cdbba9-e3a6-4c94-a5bb-618da97c94c4 req-ccad3497-53b9-42bf-8fcd-176a50242d25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e3ca69d-4e09-4205-b6ec-2a6189724e46", "name": "network-vif-plugged", "status": "completed", "tag": "b51a5869-7eac-401f-ad13-59a689851a50"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:46:07.565119 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:46:07.565119 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:46:07.571850 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-76cdbba9-e3a6-4c94-a5bb-618da97c94c4 req-ccad3497-53b9-42bf-8fcd-176a50242d25 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:07.572290 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-76cdbba9-e3a6-4c94-a5bb-618da97c94c4 req-ccad3497-53b9-42bf-8fcd-176a50242d25 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:07.582924 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-76cdbba9-e3a6-4c94-a5bb-618da97c94c4 req-ccad3497-53b9-42bf-8fcd-176a50242d25 service nova] Creating event network-vif-plugged:b51a5869-7eac-401f-ad13-59a689851a50 for instance 4e3ca69d-4e09-4205-b6ec-2a6189724e46 on hv-cinder-81565 Oct 28 08:46:07.587858 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-76cdbba9-e3a6-4c94-a5bb-618da97c94c4 req-ccad3497-53b9-42bf-8fcd-176a50242d25 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211998 Oct 28 08:46:07.588437 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 494/990] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:46:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:46:08.075570 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5bd2c719-8621-4398-a048-47af8f269ebf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:08.076431 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5bd2c719-8621-4398-a048-47af8f269ebf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:08.094842 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bd2c719-8621-4398-a048-47af8f269ebf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:08.095646 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bd2c719-8621-4398-a048-47af8f269ebf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:08.096668 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bd2c719-8621-4398-a048-47af8f269ebf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:08.097180 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bd2c719-8621-4398-a048-47af8f269ebf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:08.281819 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-5bd2c719-8621-4398-a048-47af8f269ebf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:08.296112 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-5bd2c719-8621-4398-a048-47af8f269ebf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:08.299457 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-5bd2c719-8621-4398-a048-47af8f269ebf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:08.301237 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5bd2c719-8621-4398-a048-47af8f269ebf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.229939 Oct 28 08:46:08.301809 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 497/991] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:08 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:09.321858 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-538ad998-ddc2-439f-b255-682a39666602 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:09.322592 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-538ad998-ddc2-439f-b255-682a39666602 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:09.329112 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-538ad998-ddc2-439f-b255-682a39666602 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:09.329559 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-538ad998-ddc2-439f-b255-682a39666602 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:09.330333 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-538ad998-ddc2-439f-b255-682a39666602 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:09.330790 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-538ad998-ddc2-439f-b255-682a39666602 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:09.453046 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-538ad998-ddc2-439f-b255-682a39666602 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:09.462575 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-538ad998-ddc2-439f-b255-682a39666602 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:09.464862 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-538ad998-ddc2-439f-b255-682a39666602 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:09.466075 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-538ad998-ddc2-439f-b255-682a39666602 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.148681 Oct 28 08:46:09.466731 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 495/992] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:09 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:10.485237 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1b0ff80f-13dd-4f5b-b67e-d0a69a7f5240 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:10.485848 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1b0ff80f-13dd-4f5b-b67e-d0a69a7f5240 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:10.492973 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b0ff80f-13dd-4f5b-b67e-d0a69a7f5240 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:10.493421 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b0ff80f-13dd-4f5b-b67e-d0a69a7f5240 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:10.494191 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b0ff80f-13dd-4f5b-b67e-d0a69a7f5240 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:10.494664 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b0ff80f-13dd-4f5b-b67e-d0a69a7f5240 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:10.625143 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1b0ff80f-13dd-4f5b-b67e-d0a69a7f5240 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:10.633257 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1b0ff80f-13dd-4f5b-b67e-d0a69a7f5240 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:10.634752 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1b0ff80f-13dd-4f5b-b67e-d0a69a7f5240 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:10.636409 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1b0ff80f-13dd-4f5b-b67e-d0a69a7f5240 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1807 microversion: 2.20 time: 0.154564 Oct 28 08:46:10.636952 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 498/993] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:10 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:46:11.654586 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-516ea040-ad9f-4213-8f71-de28152fa64d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:11.655211 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-516ea040-ad9f-4213-8f71-de28152fa64d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:11.662923 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-516ea040-ad9f-4213-8f71-de28152fa64d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:11.663460 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-516ea040-ad9f-4213-8f71-de28152fa64d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:11.664699 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-516ea040-ad9f-4213-8f71-de28152fa64d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:11.665171 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-516ea040-ad9f-4213-8f71-de28152fa64d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:11.800151 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-516ea040-ad9f-4213-8f71-de28152fa64d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:11.809047 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-516ea040-ad9f-4213-8f71-de28152fa64d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:11.810578 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-516ea040-ad9f-4213-8f71-de28152fa64d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:11.811740 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-516ea040-ad9f-4213-8f71-de28152fa64d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1794 microversion: 2.20 time: 0.161055 Oct 28 08:46:11.812294 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 496/994] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:46:11 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1794 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:46:36.168069 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c216e938-774b-452f-a81b-32e8f7c49986 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:36.169255 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c216e938-774b-452f-a81b-32e8f7c49986 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:36.175034 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c216e938-774b-452f-a81b-32e8f7c49986 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:36.175470 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c216e938-774b-452f-a81b-32e8f7c49986 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:36.176218 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c216e938-774b-452f-a81b-32e8f7c49986 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:36.176641 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c216e938-774b-452f-a81b-32e8f7c49986 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:36.255291 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-c216e938-774b-452f-a81b-32e8f7c49986 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lazy-loading 'services' on Instance uuid 914cd123-e872-418a-bf38-f477fe1551b3 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:46:36.325268 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c216e938-774b-452f-a81b-32e8f7c49986 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "DELETE /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/os-volume_attachments/d3bd1c6c-6bd5-4311-b8c8-6ea13fb211c3" status: 202 len: 0 microversion: 2.1 time: 0.160200 Oct 28 08:46:36.326020 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 499/995] 10.222.0.76 () {58 vars in 1415 bytes} [Thu Oct 28 08:46:36 2021] DELETE /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/os-volume_attachments/d3bd1c6c-6bd5-4311-b8c8-6ea13fb211c3 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:46:37.435718 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2f088e40-b006-4fe2-9d78-b48b69b62e7a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:46:37.441863 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f088e40-b006-4fe2-9d78-b48b69b62e7a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:37.442306 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f088e40-b006-4fe2-9d78-b48b69b62e7a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:37.464612 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2f088e40-b006-4fe2-9d78-b48b69b62e7a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Going to try to stop instance {{(pid=122256) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 28 08:46:37.505278 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2f088e40-b006-4fe2-9d78-b48b69b62e7a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 202 len: 0 microversion: 2.1 time: 0.073363 Oct 28 08:46:37.505886 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 497/996] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:46:37 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:46:37.515710 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-32e3c177-3eb8-4262-8156-3c1671f835c8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:37.516397 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-32e3c177-3eb8-4262-8156-3c1671f835c8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:37.522742 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32e3c177-3eb8-4262-8156-3c1671f835c8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:37.523181 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32e3c177-3eb8-4262-8156-3c1671f835c8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:37.523954 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32e3c177-3eb8-4262-8156-3c1671f835c8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:37.524379 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32e3c177-3eb8-4262-8156-3c1671f835c8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:37.650471 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-32e3c177-3eb8-4262-8156-3c1671f835c8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:37.657904 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-32e3c177-3eb8-4262-8156-3c1671f835c8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1676 microversion: 2.1 time: 0.147537 Oct 28 08:46:37.658489 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 500/997] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:37 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:38.676618 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-76a47870-39db-4bdc-b57d-130a1b3c4d67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:38.677322 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-76a47870-39db-4bdc-b57d-130a1b3c4d67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:38.683458 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76a47870-39db-4bdc-b57d-130a1b3c4d67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:38.683907 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76a47870-39db-4bdc-b57d-130a1b3c4d67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:38.684872 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76a47870-39db-4bdc-b57d-130a1b3c4d67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:38.685306 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76a47870-39db-4bdc-b57d-130a1b3c4d67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:38.814253 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-76a47870-39db-4bdc-b57d-130a1b3c4d67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:38.821473 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-76a47870-39db-4bdc-b57d-130a1b3c4d67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1676 microversion: 2.1 time: 0.149449 Oct 28 08:46:38.822038 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 498/998] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:38 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:39.838998 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7b185bf9-18d3-4bb7-bd13-b4e06901e5d9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:39.839624 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7b185bf9-18d3-4bb7-bd13-b4e06901e5d9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:39.846719 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b185bf9-18d3-4bb7-bd13-b4e06901e5d9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:39.847171 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b185bf9-18d3-4bb7-bd13-b4e06901e5d9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:39.847943 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b185bf9-18d3-4bb7-bd13-b4e06901e5d9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:39.848376 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b185bf9-18d3-4bb7-bd13-b4e06901e5d9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:39.969125 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-7b185bf9-18d3-4bb7-bd13-b4e06901e5d9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:39.977324 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7b185bf9-18d3-4bb7-bd13-b4e06901e5d9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1676 microversion: 2.1 time: 0.141970 Oct 28 08:46:39.977880 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 501/999] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:39 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1676 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:46:40.994394 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-72cf2dcc-52e9-4225-a3f9-50b52502ad80 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:40.995015 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-72cf2dcc-52e9-4225-a3f9-50b52502ad80 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:41.001883 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-72cf2dcc-52e9-4225-a3f9-50b52502ad80 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:41.002327 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-72cf2dcc-52e9-4225-a3f9-50b52502ad80 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:41.003117 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-72cf2dcc-52e9-4225-a3f9-50b52502ad80 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:41.003549 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-72cf2dcc-52e9-4225-a3f9-50b52502ad80 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:41.125649 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-72cf2dcc-52e9-4225-a3f9-50b52502ad80 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:41.132990 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-72cf2dcc-52e9-4225-a3f9-50b52502ad80 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1676 microversion: 2.1 time: 0.142254 Oct 28 08:46:41.133547 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 499/1000] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:40 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1676 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:42.150400 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1a56206a-479d-4e29-9801-d550f67c35d8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:42.151032 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1a56206a-479d-4e29-9801-d550f67c35d8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:42.157310 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a56206a-479d-4e29-9801-d550f67c35d8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:42.157761 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a56206a-479d-4e29-9801-d550f67c35d8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:42.158558 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a56206a-479d-4e29-9801-d550f67c35d8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:42.159024 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a56206a-479d-4e29-9801-d550f67c35d8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:42.282960 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1a56206a-479d-4e29-9801-d550f67c35d8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:42.290189 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1a56206a-479d-4e29-9801-d550f67c35d8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1676 microversion: 2.1 time: 0.143524 Oct 28 08:46:42.290782 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 502/1001] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:42 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1676 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:43.307379 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-66e3c55d-5d22-416a-b432-cb62149592a4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:43.307976 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-66e3c55d-5d22-416a-b432-cb62149592a4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:43.314272 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66e3c55d-5d22-416a-b432-cb62149592a4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:43.314761 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66e3c55d-5d22-416a-b432-cb62149592a4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:43.315520 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66e3c55d-5d22-416a-b432-cb62149592a4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:43.315951 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66e3c55d-5d22-416a-b432-cb62149592a4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:43.436426 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-66e3c55d-5d22-416a-b432-cb62149592a4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:43.443872 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-66e3c55d-5d22-416a-b432-cb62149592a4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1676 microversion: 2.1 time: 0.140169 Oct 28 08:46:43.444470 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 500/1002] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:43 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1676 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:43.533761 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 08:46:43.533981 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: Thu Oct 28 08:46:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 08:46:44.461070 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-866e87d0-31e7-4a2b-93cb-5e7676ab96a8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:44.461608 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-866e87d0-31e7-4a2b-93cb-5e7676ab96a8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:44.468956 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-866e87d0-31e7-4a2b-93cb-5e7676ab96a8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:44.469401 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-866e87d0-31e7-4a2b-93cb-5e7676ab96a8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:44.470163 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-866e87d0-31e7-4a2b-93cb-5e7676ab96a8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:44.470656 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-866e87d0-31e7-4a2b-93cb-5e7676ab96a8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:44.591566 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-866e87d0-31e7-4a2b-93cb-5e7676ab96a8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:44.599018 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-866e87d0-31e7-4a2b-93cb-5e7676ab96a8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1676 microversion: 2.1 time: 0.141677 Oct 28 08:46:44.599568 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 503/1003] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:44 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1676 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:45.616972 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2cb9323d-d7bf-4175-b33e-0d72fa920088 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:45.617567 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2cb9323d-d7bf-4175-b33e-0d72fa920088 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:45.624544 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2cb9323d-d7bf-4175-b33e-0d72fa920088 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:45.625015 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2cb9323d-d7bf-4175-b33e-0d72fa920088 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:45.625781 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2cb9323d-d7bf-4175-b33e-0d72fa920088 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:45.626210 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2cb9323d-d7bf-4175-b33e-0d72fa920088 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:45.755047 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-2cb9323d-d7bf-4175-b33e-0d72fa920088 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:45.762528 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2cb9323d-d7bf-4175-b33e-0d72fa920088 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1676 microversion: 2.1 time: 0.149145 Oct 28 08:46:45.763089 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 501/1004] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:45 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:46.779305 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-00ffdf0a-16da-4256-b00e-9481460c8bf1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:46.779891 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-00ffdf0a-16da-4256-b00e-9481460c8bf1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:46.786113 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00ffdf0a-16da-4256-b00e-9481460c8bf1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:46.786581 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00ffdf0a-16da-4256-b00e-9481460c8bf1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:46.787352 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00ffdf0a-16da-4256-b00e-9481460c8bf1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:46.787772 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00ffdf0a-16da-4256-b00e-9481460c8bf1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:46.908783 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-00ffdf0a-16da-4256-b00e-9481460c8bf1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:46.916144 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-00ffdf0a-16da-4256-b00e-9481460c8bf1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1676 microversion: 2.1 time: 0.140655 Oct 28 08:46:46.916702 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 504/1005] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:46 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1676 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:47.933411 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c24c81f3-add9-43ff-b812-d71897ef7dd0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:47.934174 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c24c81f3-add9-43ff-b812-d71897ef7dd0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:47.940340 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c24c81f3-add9-43ff-b812-d71897ef7dd0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:47.940788 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c24c81f3-add9-43ff-b812-d71897ef7dd0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:47.941562 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c24c81f3-add9-43ff-b812-d71897ef7dd0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:47.941998 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c24c81f3-add9-43ff-b812-d71897ef7dd0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:48.066009 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c24c81f3-add9-43ff-b812-d71897ef7dd0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:48.073346 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c24c81f3-add9-43ff-b812-d71897ef7dd0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1676 microversion: 2.1 time: 0.143613 Oct 28 08:46:48.073910 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 502/1006] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:47 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1676 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:49.091617 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-78d1b7a6-9647-413b-9303-57773419f138 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:49.092507 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-78d1b7a6-9647-413b-9303-57773419f138 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:49.098823 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78d1b7a6-9647-413b-9303-57773419f138 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:49.099271 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78d1b7a6-9647-413b-9303-57773419f138 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:49.100044 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78d1b7a6-9647-413b-9303-57773419f138 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:49.100474 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78d1b7a6-9647-413b-9303-57773419f138 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:49.227115 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-78d1b7a6-9647-413b-9303-57773419f138 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:49.234490 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-78d1b7a6-9647-413b-9303-57773419f138 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1676 microversion: 2.1 time: 0.147459 Oct 28 08:46:49.235061 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 505/1007] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:49 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:50.252483 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-262b8bb2-a77d-45a8-b758-9c86af04b6c2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:50.253082 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-262b8bb2-a77d-45a8-b758-9c86af04b6c2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:50.259451 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-262b8bb2-a77d-45a8-b758-9c86af04b6c2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:50.259884 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-262b8bb2-a77d-45a8-b758-9c86af04b6c2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:50.260638 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-262b8bb2-a77d-45a8-b758-9c86af04b6c2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:50.261060 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-262b8bb2-a77d-45a8-b758-9c86af04b6c2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:50.387818 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-262b8bb2-a77d-45a8-b758-9c86af04b6c2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:50.395075 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-262b8bb2-a77d-45a8-b758-9c86af04b6c2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1676 microversion: 2.1 time: 0.146243 Oct 28 08:46:50.395631 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 503/1008] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:50 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:51.412157 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4ead66e2-947c-4479-a650-ad4d11421c9e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:51.412713 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4ead66e2-947c-4479-a650-ad4d11421c9e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:51.419043 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ead66e2-947c-4479-a650-ad4d11421c9e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:51.419492 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ead66e2-947c-4479-a650-ad4d11421c9e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:51.420266 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ead66e2-947c-4479-a650-ad4d11421c9e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:51.420698 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ead66e2-947c-4479-a650-ad4d11421c9e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:51.539337 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-4ead66e2-947c-4479-a650-ad4d11421c9e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:51.547052 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4ead66e2-947c-4479-a650-ad4d11421c9e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1676 microversion: 2.1 time: 0.138711 Oct 28 08:46:51.547612 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 506/1009] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:51 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1676 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:52.565220 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e8c934fd-4728-478f-99c1-d6bba76fb29a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:52.565848 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e8c934fd-4728-478f-99c1-d6bba76fb29a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:52.572460 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8c934fd-4728-478f-99c1-d6bba76fb29a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:52.572898 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8c934fd-4728-478f-99c1-d6bba76fb29a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:52.573660 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8c934fd-4728-478f-99c1-d6bba76fb29a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:52.575287 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8c934fd-4728-478f-99c1-d6bba76fb29a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:52.720262 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-e8c934fd-4728-478f-99c1-d6bba76fb29a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:52.727951 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e8c934fd-4728-478f-99c1-d6bba76fb29a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1676 microversion: 2.1 time: 0.167656 Oct 28 08:46:52.728511 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 504/1010] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:52 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:53.745354 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8ef9943a-2a5f-4b56-8b76-adb86c99eb45 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:53.746599 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8ef9943a-2a5f-4b56-8b76-adb86c99eb45 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:53.752733 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ef9943a-2a5f-4b56-8b76-adb86c99eb45 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:53.753172 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ef9943a-2a5f-4b56-8b76-adb86c99eb45 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:53.753923 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ef9943a-2a5f-4b56-8b76-adb86c99eb45 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:53.754345 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ef9943a-2a5f-4b56-8b76-adb86c99eb45 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:53.879995 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-8ef9943a-2a5f-4b56-8b76-adb86c99eb45 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:53.888099 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8ef9943a-2a5f-4b56-8b76-adb86c99eb45 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1676 microversion: 2.1 time: 0.146309 Oct 28 08:46:53.888665 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 507/1011] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:53 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:54.905616 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-38b9e694-c761-488a-a4b3-deedf01f1c2b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:54.906220 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-38b9e694-c761-488a-a4b3-deedf01f1c2b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:54.912621 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38b9e694-c761-488a-a4b3-deedf01f1c2b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:54.913041 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38b9e694-c761-488a-a4b3-deedf01f1c2b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:54.913844 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38b9e694-c761-488a-a4b3-deedf01f1c2b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:54.914275 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38b9e694-c761-488a-a4b3-deedf01f1c2b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:55.036509 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-38b9e694-c761-488a-a4b3-deedf01f1c2b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:55.044672 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-38b9e694-c761-488a-a4b3-deedf01f1c2b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1676 microversion: 2.1 time: 0.143425 Oct 28 08:46:55.045233 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 505/1012] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:54 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1676 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:56.061589 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6518de34-02f2-4a0c-b5d3-6269f94806fc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:56.062132 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6518de34-02f2-4a0c-b5d3-6269f94806fc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:56.069131 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6518de34-02f2-4a0c-b5d3-6269f94806fc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:56.069602 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6518de34-02f2-4a0c-b5d3-6269f94806fc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:56.070379 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6518de34-02f2-4a0c-b5d3-6269f94806fc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:56.070841 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6518de34-02f2-4a0c-b5d3-6269f94806fc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:56.195342 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-6518de34-02f2-4a0c-b5d3-6269f94806fc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:56.202567 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6518de34-02f2-4a0c-b5d3-6269f94806fc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1676 microversion: 2.1 time: 0.144712 Oct 28 08:46:56.203127 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 508/1013] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:56 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1676 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:57.219647 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-db2217a3-60b4-4ff9-8c9b-576c24112a67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:57.220256 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-db2217a3-60b4-4ff9-8c9b-576c24112a67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:57.226459 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db2217a3-60b4-4ff9-8c9b-576c24112a67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:57.226941 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db2217a3-60b4-4ff9-8c9b-576c24112a67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:57.227702 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db2217a3-60b4-4ff9-8c9b-576c24112a67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:57.228136 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db2217a3-60b4-4ff9-8c9b-576c24112a67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:57.350624 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-db2217a3-60b4-4ff9-8c9b-576c24112a67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:57.358107 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-db2217a3-60b4-4ff9-8c9b-576c24112a67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1676 microversion: 2.1 time: 0.142326 Oct 28 08:46:57.358819 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 506/1014] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:57 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1676 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:58.375467 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-08bc5f9a-8bd4-498e-b012-7844f203c401 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:58.376001 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-08bc5f9a-8bd4-498e-b012-7844f203c401 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:58.382200 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08bc5f9a-8bd4-498e-b012-7844f203c401 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:58.382689 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08bc5f9a-8bd4-498e-b012-7844f203c401 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:58.383462 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08bc5f9a-8bd4-498e-b012-7844f203c401 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:58.383897 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08bc5f9a-8bd4-498e-b012-7844f203c401 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:58.504359 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-08bc5f9a-8bd4-498e-b012-7844f203c401 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:58.512294 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-08bc5f9a-8bd4-498e-b012-7844f203c401 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1653 microversion: 2.1 time: 0.140447 Oct 28 08:46:58.512853 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 509/1015] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:58 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1653 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:58.528851 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a504d9af-5d30-476f-b6fb-2491415e077f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:46:58.535114 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a504d9af-5d30-476f-b6fb-2491415e077f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:58.535562 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a504d9af-5d30-476f-b6fb-2491415e077f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:58.556837 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a504d9af-5d30-476f-b6fb-2491415e077f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Going to try to start instance {{(pid=122256) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 28 08:46:58.597971 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a504d9af-5d30-476f-b6fb-2491415e077f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action" status: 202 len: 0 microversion: 2.1 time: 0.073215 Oct 28 08:46:58.598587 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 507/1016] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:46:58 2021] POST /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:46:58.606816 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e5c3fa35-0351-41b0-ba0a-659a8c1c3239 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:58.607439 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e5c3fa35-0351-41b0-ba0a-659a8c1c3239 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:58.613247 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5c3fa35-0351-41b0-ba0a-659a8c1c3239 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:58.613631 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5c3fa35-0351-41b0-ba0a-659a8c1c3239 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:58.614398 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5c3fa35-0351-41b0-ba0a-659a8c1c3239 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:58.614892 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5c3fa35-0351-41b0-ba0a-659a8c1c3239 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:58.772775 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-e5c3fa35-0351-41b0-ba0a-659a8c1c3239 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:58.781631 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e5c3fa35-0351-41b0-ba0a-659a8c1c3239 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1662 microversion: 2.1 time: 0.178662 Oct 28 08:46:58.782214 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 510/1017] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:58 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1662 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:46:59.799822 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-47c4d237-a457-44bd-a46f-ea1624ff441a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:46:59.800512 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-47c4d237-a457-44bd-a46f-ea1624ff441a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:46:59.806954 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47c4d237-a457-44bd-a46f-ea1624ff441a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:59.807397 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47c4d237-a457-44bd-a46f-ea1624ff441a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:59.808280 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47c4d237-a457-44bd-a46f-ea1624ff441a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:46:59.808969 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47c4d237-a457-44bd-a46f-ea1624ff441a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:46:59.932933 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-47c4d237-a457-44bd-a46f-ea1624ff441a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:46:59.940347 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-47c4d237-a457-44bd-a46f-ea1624ff441a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1662 microversion: 2.1 time: 0.144650 Oct 28 08:46:59.940914 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 508/1018] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:46:59 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1662 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:00.958083 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-679d43b9-bfd8-4452-afdf-8e6df2abe868 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:00.958736 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-679d43b9-bfd8-4452-afdf-8e6df2abe868 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:00.965752 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-679d43b9-bfd8-4452-afdf-8e6df2abe868 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:00.966200 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-679d43b9-bfd8-4452-afdf-8e6df2abe868 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:00.967262 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-679d43b9-bfd8-4452-afdf-8e6df2abe868 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:00.967695 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-679d43b9-bfd8-4452-afdf-8e6df2abe868 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:01.157194 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-679d43b9-bfd8-4452-afdf-8e6df2abe868 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:01.164443 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-679d43b9-bfd8-4452-afdf-8e6df2abe868 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1666 microversion: 2.1 time: 0.210053 Oct 28 08:47:01.164991 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 511/1019] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:47:00 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1666 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:18.678486 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5996ed37-9e29-40e6-b3fa-4665ade9380d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:18.679133 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5996ed37-9e29-40e6-b3fa-4665ade9380d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:18.684892 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5996ed37-9e29-40e6-b3fa-4665ade9380d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:18.685335 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5996ed37-9e29-40e6-b3fa-4665ade9380d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:18.686095 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5996ed37-9e29-40e6-b3fa-4665ade9380d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:18.686679 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5996ed37-9e29-40e6-b3fa-4665ade9380d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:18.717342 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5996ed37-9e29-40e6-b3fa-4665ade9380d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/os-volume_attachments/1c315ff7-d73b-4e98-97b8-4befd42c223d" status: 200 len: 194 microversion: 2.20 time: 0.042698 Oct 28 08:47:18.717909 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 509/1020] 10.222.0.76 () {60 vars in 1453 bytes} [Thu Oct 28 08:47:18 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/os-volume_attachments/1c315ff7-d73b-4e98-97b8-4befd42c223d => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:47:18.778259 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-900d14f7-4712-47e7-85c3-d4bb3a1a1ccd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:18.778819 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-900d14f7-4712-47e7-85c3-d4bb3a1a1ccd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:18.785696 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-900d14f7-4712-47e7-85c3-d4bb3a1a1ccd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:18.786141 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-900d14f7-4712-47e7-85c3-d4bb3a1a1ccd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:18.786924 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-900d14f7-4712-47e7-85c3-d4bb3a1a1ccd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:18.787474 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-900d14f7-4712-47e7-85c3-d4bb3a1a1ccd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:18.865506 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-900d14f7-4712-47e7-85c3-d4bb3a1a1ccd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lazy-loading 'services' on Instance uuid 4e3ca69d-4e09-4205-b6ec-2a6189724e46 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:47:18.942210 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-900d14f7-4712-47e7-85c3-d4bb3a1a1ccd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "DELETE /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/os-volume_attachments/1c315ff7-d73b-4e98-97b8-4befd42c223d" status: 202 len: 0 microversion: 2.20 time: 0.167464 Oct 28 08:47:18.942768 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 512/1021] 10.222.0.76 () {60 vars in 1456 bytes} [Thu Oct 28 08:47:18 2021] DELETE /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/os-volume_attachments/1c315ff7-d73b-4e98-97b8-4befd42c223d => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:47:18.951667 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-715ad0a0-aa8f-4f7d-8cf4-1f47ba82c464 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:18.952640 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-715ad0a0-aa8f-4f7d-8cf4-1f47ba82c464 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:18.958791 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-715ad0a0-aa8f-4f7d-8cf4-1f47ba82c464 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:18.959367 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-715ad0a0-aa8f-4f7d-8cf4-1f47ba82c464 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:18.960224 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-715ad0a0-aa8f-4f7d-8cf4-1f47ba82c464 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:18.960928 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-715ad0a0-aa8f-4f7d-8cf4-1f47ba82c464 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:18.994288 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-715ad0a0-aa8f-4f7d-8cf4-1f47ba82c464 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047125 Oct 28 08:47:18.998228 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 510/1022] 10.222.0.76 () {60 vars in 1342 bytes} [Thu Oct 28 08:47:18 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:47:20.007120 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6614349b-03ad-480d-86dc-d41ae0a0f101 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:20.008131 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6614349b-03ad-480d-86dc-d41ae0a0f101 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:20.014221 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6614349b-03ad-480d-86dc-d41ae0a0f101 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:20.014710 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6614349b-03ad-480d-86dc-d41ae0a0f101 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:20.015484 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6614349b-03ad-480d-86dc-d41ae0a0f101 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:20.015928 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6614349b-03ad-480d-86dc-d41ae0a0f101 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:20.044341 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6614349b-03ad-480d-86dc-d41ae0a0f101 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042110 Oct 28 08:47:20.044883 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 513/1023] 10.222.0.76 () {60 vars in 1342 bytes} [Thu Oct 28 08:47:20 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:20.101098 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-261c78e1-b066-4f45-8373-ab531924fe59 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:20.101625 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-261c78e1-b066-4f45-8373-ab531924fe59 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:20.107850 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-261c78e1-b066-4f45-8373-ab531924fe59 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:20.108296 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-261c78e1-b066-4f45-8373-ab531924fe59 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:20.110008 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-261c78e1-b066-4f45-8373-ab531924fe59 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:20.110008 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-261c78e1-b066-4f45-8373-ab531924fe59 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:20.134558 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-261c78e1-b066-4f45-8373-ab531924fe59 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:47:20.206808 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-261c78e1-b066-4f45-8373-ab531924fe59 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "DELETE /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 204 len: 0 microversion: 2.20 time: 0.109100 Oct 28 08:47:20.207391 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 511/1024] 10.222.0.76 () {60 vars in 1279 bytes} [Thu Oct 28 08:47:20 2021] DELETE /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 08:47:20.216289 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-745c02a3-2e83-4d1b-983b-7cd19708f670 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:20.216925 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-745c02a3-2e83-4d1b-983b-7cd19708f670 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:20.223262 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-745c02a3-2e83-4d1b-983b-7cd19708f670 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:20.223714 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-745c02a3-2e83-4d1b-983b-7cd19708f670 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:20.224481 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-745c02a3-2e83-4d1b-983b-7cd19708f670 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:20.224916 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-745c02a3-2e83-4d1b-983b-7cd19708f670 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:20.348692 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-745c02a3-2e83-4d1b-983b-7cd19708f670 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:20.356472 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-745c02a3-2e83-4d1b-983b-7cd19708f670 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:20.357952 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-745c02a3-2e83-4d1b-983b-7cd19708f670 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:20.359840 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-745c02a3-2e83-4d1b-983b-7cd19708f670 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.147029 Oct 28 08:47:20.360563 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 514/1025] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:47:20 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:47:21.379360 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9a12f312-3ecd-42fb-96c6-2c3e37181087 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:21.379977 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9a12f312-3ecd-42fb-96c6-2c3e37181087 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:21.386422 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a12f312-3ecd-42fb-96c6-2c3e37181087 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:21.386891 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a12f312-3ecd-42fb-96c6-2c3e37181087 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:21.387691 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a12f312-3ecd-42fb-96c6-2c3e37181087 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:21.388206 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a12f312-3ecd-42fb-96c6-2c3e37181087 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:21.509078 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-9a12f312-3ecd-42fb-96c6-2c3e37181087 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:21.517046 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-9a12f312-3ecd-42fb-96c6-2c3e37181087 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:21.518585 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-9a12f312-3ecd-42fb-96c6-2c3e37181087 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:21.519758 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9a12f312-3ecd-42fb-96c6-2c3e37181087 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.145344 Oct 28 08:47:21.520305 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 512/1026] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:47:21 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:47:22.537672 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-74d5bcbf-331d-423f-b6c3-1668162e0a31 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:22.538302 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-74d5bcbf-331d-423f-b6c3-1668162e0a31 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:22.544616 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74d5bcbf-331d-423f-b6c3-1668162e0a31 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:22.545054 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74d5bcbf-331d-423f-b6c3-1668162e0a31 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:22.545827 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74d5bcbf-331d-423f-b6c3-1668162e0a31 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:22.546245 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74d5bcbf-331d-423f-b6c3-1668162e0a31 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:22.824794 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-74d5bcbf-331d-423f-b6c3-1668162e0a31 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:22.834286 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-74d5bcbf-331d-423f-b6c3-1668162e0a31 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:22.835812 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-74d5bcbf-331d-423f-b6c3-1668162e0a31 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:22.836969 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-74d5bcbf-331d-423f-b6c3-1668162e0a31 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 200 len: 1722 microversion: 2.20 time: 0.303034 Oct 28 08:47:22.837529 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 515/1027] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:47:22 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 1722 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:47:23.264684 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-16043e4f-37ce-4cb9-a685-fdcba8ca6916 req-6eb4a8ba-107e-40a0-8be0-27d9b4888b05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e3ca69d-4e09-4205-b6ec-2a6189724e46", "name": "network-vif-deleted", "tag": "b51a5869-7eac-401f-ad13-59a689851a50"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:23.267757 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:47:23.267757 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:47:23.278133 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-16043e4f-37ce-4cb9-a685-fdcba8ca6916 req-6eb4a8ba-107e-40a0-8be0-27d9b4888b05 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:23.278944 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-16043e4f-37ce-4cb9-a685-fdcba8ca6916 req-6eb4a8ba-107e-40a0-8be0-27d9b4888b05 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:23.292991 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-16043e4f-37ce-4cb9-a685-fdcba8ca6916 req-6eb4a8ba-107e-40a0-8be0-27d9b4888b05 service nova] Creating event network-vif-deleted:b51a5869-7eac-401f-ad13-59a689851a50 for instance 4e3ca69d-4e09-4205-b6ec-2a6189724e46 on hv-cinder-81565 Oct 28 08:47:23.300536 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-16043e4f-37ce-4cb9-a685-fdcba8ca6916 req-6eb4a8ba-107e-40a0-8be0-27d9b4888b05 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039763 Oct 28 08:47:23.301157 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 513/1028] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:47:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:47:23.856253 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b28a72fb-a9ae-453d-9b31-e7c2ec43eadc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:23.856826 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b28a72fb-a9ae-453d-9b31-e7c2ec43eadc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:23.864635 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b28a72fb-a9ae-453d-9b31-e7c2ec43eadc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:23.865087 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b28a72fb-a9ae-453d-9b31-e7c2ec43eadc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:23.865906 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b28a72fb-a9ae-453d-9b31-e7c2ec43eadc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:23.866346 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b28a72fb-a9ae-453d-9b31-e7c2ec43eadc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:23.881032 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-b28a72fb-a9ae-453d-9b31-e7c2ec43eadc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] HTTP exception thrown: Instance 4e3ca69d-4e09-4205-b6ec-2a6189724e46 could not be found. Oct 28 08:47:23.881779 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b28a72fb-a9ae-453d-9b31-e7c2ec43eadc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Returning 404 to user: Instance 4e3ca69d-4e09-4205-b6ec-2a6189724e46 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:47:23.882849 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b28a72fb-a9ae-453d-9b31-e7c2ec43eadc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 404 len: 111 microversion: 2.20 time: 0.030725 Oct 28 08:47:23.883580 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 516/1029] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:47:23 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 08:47:23.892623 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1861c6a8-2142-44e9-8cff-dc2152f3a5e3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '.version_select at 0x7fed73807c10>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:23.918855 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1861c6a8-2142-44e9-8cff-dc2152f3a5e3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-410872415" status: 204 len: 0 microversion: 2.20 time: 0.030112 Oct 28 08:47:23.919335 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 514/1030] 10.222.0.76 () {60 vars in 1258 bytes} [Thu Oct 28 08:47:23 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-410872415 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 08:47:24.709468 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-19b643fb-5a76-4cc2-a2d0-7b34730adba3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'create', calling method: .version_select at 0x7fed6e83b0d0>, body: {"keypair": {"name": "tempest-keypair-1136516755"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:24.728311 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-19b643fb-5a76-4cc2-a2d0-7b34730adba3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Getting quotas for project caed8624c42e4e4aab79cb3ca12ef824. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:47:24.732679 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-19b643fb-5a76-4cc2-a2d0-7b34730adba3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Getting quotas for user a8a8c3c685aa49499037c493b1b99eed and project caed8624c42e4e4aab79cb3ca12ef824. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:47:24.933969 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-19b643fb-5a76-4cc2-a2d0-7b34730adba3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Getting quotas for project caed8624c42e4e4aab79cb3ca12ef824. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:47:24.937735 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-19b643fb-5a76-4cc2-a2d0-7b34730adba3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Getting quotas for user a8a8c3c685aa49499037c493b1b99eed and project caed8624c42e4e4aab79cb3ca12ef824. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:47:24.951266 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-19b643fb-5a76-4cc2-a2d0-7b34730adba3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.245600 Oct 28 08:47:24.951857 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 517/1031] 10.222.0.76 () {62 vars in 1198 bytes} [Thu Oct 28 08:47:24 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 247 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 28 08:47:26.460944 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9bfd7143-8508-438c-b837-918f92049c75 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1458967658", "imageRef": "339e99be-6a19-4324-aa16-6b690c25dede", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "523f4404-9c20-4bbb-88e2-e5dcf3255867"}], "security_groups": [{"name": "tempest-securitygroup--242027566"}], "key_name": "tempest-keypair-1136516755", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:26.556972 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-9bfd7143-8508-438c-b837-918f92049c75 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] validate_networks() for [('523f4404-9c20-4bbb-88e2-e5dcf3255867', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:47:26.929931 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-9bfd7143-8508-438c-b837-918f92049c75 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:47:26.930343 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-9bfd7143-8508-438c-b837-918f92049c75 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:47:26.930854 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-9bfd7143-8508-438c-b837-918f92049c75 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:47:26.931256 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-9bfd7143-8508-438c-b837-918f92049c75 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:47:26.931658 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-9bfd7143-8508-438c-b837-918f92049c75 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:47:26.941222 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bfd7143-8508-438c-b837-918f92049c75 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:26.941658 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bfd7143-8508-438c-b837-918f92049c75 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:26.942465 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bfd7143-8508-438c-b837-918f92049c75 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:26.942906 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bfd7143-8508-438c-b837-918f92049c75 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:26.959167 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-9bfd7143-8508-438c-b837-918f92049c75 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Getting quotas for project caed8624c42e4e4aab79cb3ca12ef824. Resources: {'instances', 'cores', 'ram'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:47:26.962948 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-9bfd7143-8508-438c-b837-918f92049c75 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Getting quotas for user a8a8c3c685aa49499037c493b1b99eed and project caed8624c42e4e4aab79cb3ca12ef824. Resources: {'instances', 'cores', 'ram'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:47:26.975205 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9bfd7143-8508-438c-b837-918f92049c75 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:47:26.977862 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9bfd7143-8508-438c-b837-918f92049c75 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='339e99be-6a19-4324-aa16-6b690c25dede',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:47:27.027492 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9bfd7143-8508-438c-b837-918f92049c75 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.570984 Oct 28 08:47:27.028147 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 515/1032] 10.222.0.76 () {62 vars in 1187 bytes} [Thu Oct 28 08:47:26 2021] POST /compute/v2.1/servers => generated 401 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 08:47:27.039917 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6b329b83-744f-4a14-b451-e015e3276d0b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:27.040528 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6b329b83-744f-4a14-b451-e015e3276d0b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:27.093659 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-6b329b83-744f-4a14-b451-e015e3276d0b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:27.101559 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-6b329b83-744f-4a14-b451-e015e3276d0b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:27.103115 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-6b329b83-744f-4a14-b451-e015e3276d0b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:27.104560 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6b329b83-744f-4a14-b451-e015e3276d0b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1282 microversion: 2.20 time: 0.068575 Oct 28 08:47:27.105053 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 518/1033] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:47:27 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1282 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:47:28.123770 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6d09ee26-2c93-4ec0-92fb-a199f808cc5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:28.125003 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6d09ee26-2c93-4ec0-92fb-a199f808cc5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:28.131251 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d09ee26-2c93-4ec0-92fb-a199f808cc5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:28.131706 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d09ee26-2c93-4ec0-92fb-a199f808cc5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:28.132480 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d09ee26-2c93-4ec0-92fb-a199f808cc5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:28.133083 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d09ee26-2c93-4ec0-92fb-a199f808cc5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:28.200753 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-6d09ee26-2c93-4ec0-92fb-a199f808cc5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:28.208709 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-6d09ee26-2c93-4ec0-92fb-a199f808cc5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:28.210242 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-6d09ee26-2c93-4ec0-92fb-a199f808cc5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:28.211621 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6d09ee26-2c93-4ec0-92fb-a199f808cc5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1340 microversion: 2.20 time: 0.092069 Oct 28 08:47:28.212178 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 516/1034] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:47:28 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1340 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:47:29.230903 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3a9d61a5-6ecb-4255-a533-843c7890b584 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:29.231505 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3a9d61a5-6ecb-4255-a533-843c7890b584 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:29.238034 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a9d61a5-6ecb-4255-a533-843c7890b584 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:29.238479 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a9d61a5-6ecb-4255-a533-843c7890b584 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:29.239296 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a9d61a5-6ecb-4255-a533-843c7890b584 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:29.239723 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a9d61a5-6ecb-4255-a533-843c7890b584 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:29.277939 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-bf13f1ac-c446-4a82-b0a6-768c89cad852 req-82b0678c-f0cf-44ea-b5a9-a6f56e1a3600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acd087a0-4efb-4b0c-83f8-dc9577976ee7", "tag": "bd4afab1-47c9-4cd2-87f5-5d7b28f4e628"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:29.280205 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:47:29.280205 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:47:29.288267 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-bf13f1ac-c446-4a82-b0a6-768c89cad852 req-82b0678c-f0cf-44ea-b5a9-a6f56e1a3600 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:29.288708 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-bf13f1ac-c446-4a82-b0a6-768c89cad852 req-82b0678c-f0cf-44ea-b5a9-a6f56e1a3600 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:29.303521 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-bf13f1ac-c446-4a82-b0a6-768c89cad852 req-82b0678c-f0cf-44ea-b5a9-a6f56e1a3600 service nova] Creating event network-changed:bd4afab1-47c9-4cd2-87f5-5d7b28f4e628 for instance acd087a0-4efb-4b0c-83f8-dc9577976ee7 on hv-cinder-81565 Oct 28 08:47:29.308679 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-bf13f1ac-c446-4a82-b0a6-768c89cad852 req-82b0678c-f0cf-44ea-b5a9-a6f56e1a3600 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034209 Oct 28 08:47:29.309576 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 517/1035] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:47:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:47:29.496200 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3a9d61a5-6ecb-4255-a533-843c7890b584 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:29.504581 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3a9d61a5-6ecb-4255-a533-843c7890b584 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:29.506215 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3a9d61a5-6ecb-4255-a533-843c7890b584 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:29.507348 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3a9d61a5-6ecb-4255-a533-843c7890b584 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1407 microversion: 2.20 time: 0.280184 Oct 28 08:47:29.507901 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 519/1036] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:47:29 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1407 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:47:30.526508 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2d453dac-1c33-4f3f-a37e-323c864dd8ce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:30.527205 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2d453dac-1c33-4f3f-a37e-323c864dd8ce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:30.533990 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d453dac-1c33-4f3f-a37e-323c864dd8ce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:30.534369 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d453dac-1c33-4f3f-a37e-323c864dd8ce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:30.535157 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d453dac-1c33-4f3f-a37e-323c864dd8ce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:30.535590 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d453dac-1c33-4f3f-a37e-323c864dd8ce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:30.656266 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-2d453dac-1c33-4f3f-a37e-323c864dd8ce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:30.663963 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-2d453dac-1c33-4f3f-a37e-323c864dd8ce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:30.665471 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-2d453dac-1c33-4f3f-a37e-323c864dd8ce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:30.666589 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2d453dac-1c33-4f3f-a37e-323c864dd8ce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1407 microversion: 2.20 time: 0.144550 Oct 28 08:47:30.667140 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 518/1037] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:47:30 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1407 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:47:31.684632 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8f82d557-c4d7-45a9-862b-da15803ef3be tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:31.685225 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8f82d557-c4d7-45a9-862b-da15803ef3be tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:31.692057 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f82d557-c4d7-45a9-862b-da15803ef3be tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:31.692492 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f82d557-c4d7-45a9-862b-da15803ef3be tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:31.693241 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f82d557-c4d7-45a9-862b-da15803ef3be tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:31.693676 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f82d557-c4d7-45a9-862b-da15803ef3be tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:31.816341 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-8f82d557-c4d7-45a9-862b-da15803ef3be tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:31.824224 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-8f82d557-c4d7-45a9-862b-da15803ef3be tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:31.825719 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-8f82d557-c4d7-45a9-862b-da15803ef3be tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:31.826856 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8f82d557-c4d7-45a9-862b-da15803ef3be tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1407 microversion: 2.20 time: 0.145877 Oct 28 08:47:31.827920 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 520/1038] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:47:31 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:47:32.844852 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8c711297-d2fe-48af-8e68-cc74fec82b67 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:32.845457 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8c711297-d2fe-48af-8e68-cc74fec82b67 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:32.851362 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c711297-d2fe-48af-8e68-cc74fec82b67 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:32.851809 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c711297-d2fe-48af-8e68-cc74fec82b67 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:32.852573 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c711297-d2fe-48af-8e68-cc74fec82b67 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:32.853009 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c711297-d2fe-48af-8e68-cc74fec82b67 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:32.978453 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-8c711297-d2fe-48af-8e68-cc74fec82b67 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:32.987164 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-8c711297-d2fe-48af-8e68-cc74fec82b67 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:32.988667 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-8c711297-d2fe-48af-8e68-cc74fec82b67 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:32.989762 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8c711297-d2fe-48af-8e68-cc74fec82b67 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1407 microversion: 2.20 time: 0.149277 Oct 28 08:47:32.990322 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 519/1039] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:47:32 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:47:34.006547 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ce5536d1-a6bc-4c6b-b89d-d6ed1d30c565 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:34.007233 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ce5536d1-a6bc-4c6b-b89d-d6ed1d30c565 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:34.013455 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce5536d1-a6bc-4c6b-b89d-d6ed1d30c565 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:34.013900 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce5536d1-a6bc-4c6b-b89d-d6ed1d30c565 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:34.014738 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce5536d1-a6bc-4c6b-b89d-d6ed1d30c565 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:34.015310 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce5536d1-a6bc-4c6b-b89d-d6ed1d30c565 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:34.136042 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-ce5536d1-a6bc-4c6b-b89d-d6ed1d30c565 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:34.144398 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-ce5536d1-a6bc-4c6b-b89d-d6ed1d30c565 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:34.145879 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-ce5536d1-a6bc-4c6b-b89d-d6ed1d30c565 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:34.147032 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ce5536d1-a6bc-4c6b-b89d-d6ed1d30c565 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1407 microversion: 2.20 time: 0.144200 Oct 28 08:47:34.147588 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 521/1040] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:47:34 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1407 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:47:35.165472 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-754ac19d-0ad0-431e-859f-1b7813373c15 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:35.166070 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-754ac19d-0ad0-431e-859f-1b7813373c15 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:35.172823 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-754ac19d-0ad0-431e-859f-1b7813373c15 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:35.173262 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-754ac19d-0ad0-431e-859f-1b7813373c15 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:35.174015 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-754ac19d-0ad0-431e-859f-1b7813373c15 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:35.174439 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-754ac19d-0ad0-431e-859f-1b7813373c15 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:35.297373 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-754ac19d-0ad0-431e-859f-1b7813373c15 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:35.305443 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-754ac19d-0ad0-431e-859f-1b7813373c15 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:35.306989 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-754ac19d-0ad0-431e-859f-1b7813373c15 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:35.308101 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-754ac19d-0ad0-431e-859f-1b7813373c15 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1407 microversion: 2.20 time: 0.146354 Oct 28 08:47:35.308657 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 520/1041] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:47:35 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:47:36.021999 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-4f1695bc-8c49-4f38-a4e4-46d0c1ce7a62 req-815d0c05-6fb5-4b15-8153-df5e8445c562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd087a0-4efb-4b0c-83f8-dc9577976ee7", "name": "network-vif-plugged", "status": "completed", "tag": "bd4afab1-47c9-4cd2-87f5-5d7b28f4e628"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:36.024155 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:47:36.024155 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:47:36.032211 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4f1695bc-8c49-4f38-a4e4-46d0c1ce7a62 req-815d0c05-6fb5-4b15-8153-df5e8445c562 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:36.032755 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4f1695bc-8c49-4f38-a4e4-46d0c1ce7a62 req-815d0c05-6fb5-4b15-8153-df5e8445c562 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:36.044139 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-4f1695bc-8c49-4f38-a4e4-46d0c1ce7a62 req-815d0c05-6fb5-4b15-8153-df5e8445c562 service nova] Creating event network-vif-plugged:bd4afab1-47c9-4cd2-87f5-5d7b28f4e628 for instance acd087a0-4efb-4b0c-83f8-dc9577976ee7 on hv-cinder-81565 Oct 28 08:47:36.049859 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-4f1695bc-8c49-4f38-a4e4-46d0c1ce7a62 req-815d0c05-6fb5-4b15-8153-df5e8445c562 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031498 Oct 28 08:47:36.050449 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 522/1042] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:47:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:47:36.326885 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2660fc9c-20c7-4b0f-a793-fbac85d0320c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:36.328670 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2660fc9c-20c7-4b0f-a793-fbac85d0320c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:36.334904 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2660fc9c-20c7-4b0f-a793-fbac85d0320c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:36.335373 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2660fc9c-20c7-4b0f-a793-fbac85d0320c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:36.336121 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2660fc9c-20c7-4b0f-a793-fbac85d0320c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:36.336541 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2660fc9c-20c7-4b0f-a793-fbac85d0320c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:36.459339 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-2660fc9c-20c7-4b0f-a793-fbac85d0320c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:36.467179 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-2660fc9c-20c7-4b0f-a793-fbac85d0320c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:36.469874 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-2660fc9c-20c7-4b0f-a793-fbac85d0320c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:36.470996 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2660fc9c-20c7-4b0f-a793-fbac85d0320c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1407 microversion: 2.20 time: 0.147824 Oct 28 08:47:36.471542 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 521/1043] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:47:36 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:47:37.490099 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3b1e7b45-bf08-4c64-9596-4b41ed691559 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:37.490744 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3b1e7b45-bf08-4c64-9596-4b41ed691559 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:37.496859 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3b1e7b45-bf08-4c64-9596-4b41ed691559 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:37.497305 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3b1e7b45-bf08-4c64-9596-4b41ed691559 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:37.498069 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3b1e7b45-bf08-4c64-9596-4b41ed691559 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:37.498521 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3b1e7b45-bf08-4c64-9596-4b41ed691559 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:37.620234 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3b1e7b45-bf08-4c64-9596-4b41ed691559 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:37.628500 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3b1e7b45-bf08-4c64-9596-4b41ed691559 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:37.630000 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3b1e7b45-bf08-4c64-9596-4b41ed691559 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:37.631136 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3b1e7b45-bf08-4c64-9596-4b41ed691559 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1407 microversion: 2.20 time: 0.145654 Oct 28 08:47:37.631701 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 523/1044] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:47:37 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:47:38.649937 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-de405ad6-2e7b-48c4-a66a-c32722ec8ec8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:38.650559 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-de405ad6-2e7b-48c4-a66a-c32722ec8ec8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:38.657472 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de405ad6-2e7b-48c4-a66a-c32722ec8ec8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:38.657916 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de405ad6-2e7b-48c4-a66a-c32722ec8ec8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:38.658714 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de405ad6-2e7b-48c4-a66a-c32722ec8ec8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:38.659156 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de405ad6-2e7b-48c4-a66a-c32722ec8ec8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:38.781365 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-de405ad6-2e7b-48c4-a66a-c32722ec8ec8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:38.790028 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-de405ad6-2e7b-48c4-a66a-c32722ec8ec8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:38.791565 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-de405ad6-2e7b-48c4-a66a-c32722ec8ec8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:47:38.792719 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-de405ad6-2e7b-48c4-a66a-c32722ec8ec8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1598 microversion: 2.20 time: 0.147204 Oct 28 08:47:38.793270 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 522/1045] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:47:38 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:47:38.810025 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b4b31a5e-5837-4be0-a465-868bc2b22b3b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:47:38.810642 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b4b31a5e-5837-4be0-a465-868bc2b22b3b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:38.816863 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4b31a5e-5837-4be0-a465-868bc2b22b3b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:38.817304 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4b31a5e-5837-4be0-a465-868bc2b22b3b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:38.818085 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4b31a5e-5837-4be0-a465-868bc2b22b3b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:38.818535 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4b31a5e-5837-4be0-a465-868bc2b22b3b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:38.897285 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b4b31a5e-5837-4be0-a465-868bc2b22b3b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090967 Oct 28 08:47:38.897882 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 524/1046] 10.222.0.76 () {60 vars in 1315 bytes} [Thu Oct 28 08:47:38 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:47:40.150080 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e3f67bb1-c3b1-4974-a742-704e543aeb74 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:40.151016 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e3f67bb1-c3b1-4974-a742-704e543aeb74 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:40.153519 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-9c141e55-6098-4781-b907-63727a06dd26 req-403941ec-4476-435a-96e5-af0419ac1bcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acd087a0-4efb-4b0c-83f8-dc9577976ee7", "tag": "bd4afab1-47c9-4cd2-87f5-5d7b28f4e628"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:40.155254 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:47:40.155254 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:47:40.158815 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3f67bb1-c3b1-4974-a742-704e543aeb74 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:40.159254 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3f67bb1-c3b1-4974-a742-704e543aeb74 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:40.160021 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3f67bb1-c3b1-4974-a742-704e543aeb74 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:40.160442 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3f67bb1-c3b1-4974-a742-704e543aeb74 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:40.163510 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9c141e55-6098-4781-b907-63727a06dd26 req-403941ec-4476-435a-96e5-af0419ac1bcf service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:40.164018 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9c141e55-6098-4781-b907-63727a06dd26 req-403941ec-4476-435a-96e5-af0419ac1bcf service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:40.175829 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-9c141e55-6098-4781-b907-63727a06dd26 req-403941ec-4476-435a-96e5-af0419ac1bcf service nova] Creating event network-changed:bd4afab1-47c9-4cd2-87f5-5d7b28f4e628 for instance acd087a0-4efb-4b0c-83f8-dc9577976ee7 on hv-cinder-81565 Oct 28 08:47:40.182387 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-9c141e55-6098-4781-b907-63727a06dd26 req-403941ec-4476-435a-96e5-af0419ac1bcf service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033304 Oct 28 08:47:40.183225 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 525/1047] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:47:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:47:40.227056 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e3f67bb1-c3b1-4974-a742-704e543aeb74 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 14 microversion: 2.20 time: 0.080366 Oct 28 08:47:40.227692 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 523/1048] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:47:40 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:41.239203 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-21d3aeb2-cfe6-411f-82f5-c45e98c2dbbd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:41.240195 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-21d3aeb2-cfe6-411f-82f5-c45e98c2dbbd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:41.246671 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21d3aeb2-cfe6-411f-82f5-c45e98c2dbbd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:41.247163 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21d3aeb2-cfe6-411f-82f5-c45e98c2dbbd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:41.247945 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21d3aeb2-cfe6-411f-82f5-c45e98c2dbbd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:41.248675 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21d3aeb2-cfe6-411f-82f5-c45e98c2dbbd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:41.309908 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-21d3aeb2-cfe6-411f-82f5-c45e98c2dbbd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 14 microversion: 2.20 time: 0.075598 Oct 28 08:47:41.310610 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 526/1049] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:47:41 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:42.321571 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1de6d5eb-944b-45f1-a7f2-1431fd7bc6e3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:42.322932 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1de6d5eb-944b-45f1-a7f2-1431fd7bc6e3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:42.331235 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1de6d5eb-944b-45f1-a7f2-1431fd7bc6e3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:42.331680 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1de6d5eb-944b-45f1-a7f2-1431fd7bc6e3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:42.332449 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1de6d5eb-944b-45f1-a7f2-1431fd7bc6e3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:42.332885 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1de6d5eb-944b-45f1-a7f2-1431fd7bc6e3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:42.392961 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1de6d5eb-944b-45f1-a7f2-1431fd7bc6e3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 14 microversion: 2.20 time: 0.075575 Oct 28 08:47:42.393516 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 524/1050] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:47:42 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:43.404334 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-487fa29e-471b-4c61-b666-f8a322084092 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:43.405239 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-487fa29e-471b-4c61-b666-f8a322084092 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:43.413065 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-487fa29e-471b-4c61-b666-f8a322084092 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:43.413498 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-487fa29e-471b-4c61-b666-f8a322084092 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:43.414256 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-487fa29e-471b-4c61-b666-f8a322084092 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:43.414721 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-487fa29e-471b-4c61-b666-f8a322084092 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:43.473985 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-487fa29e-471b-4c61-b666-f8a322084092 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 14 microversion: 2.20 time: 0.073583 Oct 28 08:47:43.474738 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 527/1051] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:47:43 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:44.490213 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-12e320bd-d28b-4f54-98bd-5a1c16b39e3b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:44.491851 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-12e320bd-d28b-4f54-98bd-5a1c16b39e3b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:44.499880 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12e320bd-d28b-4f54-98bd-5a1c16b39e3b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:44.500329 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12e320bd-d28b-4f54-98bd-5a1c16b39e3b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:44.501879 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12e320bd-d28b-4f54-98bd-5a1c16b39e3b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:44.502316 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12e320bd-d28b-4f54-98bd-5a1c16b39e3b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:44.559757 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-12e320bd-d28b-4f54-98bd-5a1c16b39e3b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 14 microversion: 2.20 time: 0.077185 Oct 28 08:47:44.560368 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 525/1052] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:47:44 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:45.571147 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6b4d68eb-2226-4624-b543-174fb4e8f1a4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:45.572175 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6b4d68eb-2226-4624-b543-174fb4e8f1a4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:45.583254 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b4d68eb-2226-4624-b543-174fb4e8f1a4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:45.583697 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b4d68eb-2226-4624-b543-174fb4e8f1a4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:45.584467 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b4d68eb-2226-4624-b543-174fb4e8f1a4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:45.584897 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b4d68eb-2226-4624-b543-174fb4e8f1a4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:45.643715 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6b4d68eb-2226-4624-b543-174fb4e8f1a4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 14 microversion: 2.20 time: 0.076369 Oct 28 08:47:45.644584 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 528/1053] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:47:45 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:46.656105 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-16c0c960-1994-440c-88ed-892044750d63 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:46.657117 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-16c0c960-1994-440c-88ed-892044750d63 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:46.663945 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16c0c960-1994-440c-88ed-892044750d63 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:46.664393 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16c0c960-1994-440c-88ed-892044750d63 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:46.665159 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16c0c960-1994-440c-88ed-892044750d63 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:46.665593 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16c0c960-1994-440c-88ed-892044750d63 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:46.730790 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-16c0c960-1994-440c-88ed-892044750d63 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 14 microversion: 2.20 time: 0.078991 Oct 28 08:47:46.731451 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 526/1054] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:47:46 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:47.742289 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-522143d6-b259-4102-871c-a35b57b32f8c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:47.743314 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-522143d6-b259-4102-871c-a35b57b32f8c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:47.750033 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-522143d6-b259-4102-871c-a35b57b32f8c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:47.750477 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-522143d6-b259-4102-871c-a35b57b32f8c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:47.751549 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-522143d6-b259-4102-871c-a35b57b32f8c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:47.751979 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-522143d6-b259-4102-871c-a35b57b32f8c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:47.825387 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-522143d6-b259-4102-871c-a35b57b32f8c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 14 microversion: 2.20 time: 0.087065 Oct 28 08:47:47.826004 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 529/1055] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:47:47 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:48.835975 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2741d741-f6b5-43b4-9da3-f60b05e68ecf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:48.836983 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2741d741-f6b5-43b4-9da3-f60b05e68ecf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:48.844075 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2741d741-f6b5-43b4-9da3-f60b05e68ecf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:48.845083 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2741d741-f6b5-43b4-9da3-f60b05e68ecf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:48.845851 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2741d741-f6b5-43b4-9da3-f60b05e68ecf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:48.846284 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2741d741-f6b5-43b4-9da3-f60b05e68ecf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:48.910923 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2741d741-f6b5-43b4-9da3-f60b05e68ecf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 14 microversion: 2.20 time: 0.078813 Oct 28 08:47:48.911561 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 527/1056] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:47:48 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:47:49.923491 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-48243833-49aa-44b4-aacf-71190ea6f0cb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:49.924655 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-48243833-49aa-44b4-aacf-71190ea6f0cb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:49.932173 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48243833-49aa-44b4-aacf-71190ea6f0cb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:49.932616 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48243833-49aa-44b4-aacf-71190ea6f0cb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:49.933396 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48243833-49aa-44b4-aacf-71190ea6f0cb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:49.933826 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48243833-49aa-44b4-aacf-71190ea6f0cb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:50.023214 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-48243833-49aa-44b4-aacf-71190ea6f0cb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 5221 microversion: 2.20 time: 0.104394 Oct 28 08:47:50.023887 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 530/1057] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:47:49 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 5221 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:47:51.035206 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cafb3cc2-3710-48f7-9ea1-c4ff430cdef2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:51.036179 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cafb3cc2-3710-48f7-9ea1-c4ff430cdef2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:51.042382 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cafb3cc2-3710-48f7-9ea1-c4ff430cdef2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:51.042851 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cafb3cc2-3710-48f7-9ea1-c4ff430cdef2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:51.043617 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cafb3cc2-3710-48f7-9ea1-c4ff430cdef2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:51.044048 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cafb3cc2-3710-48f7-9ea1-c4ff430cdef2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:51.120899 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cafb3cc2-3710-48f7-9ea1-c4ff430cdef2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 15025 microversion: 2.20 time: 0.090083 Oct 28 08:47:51.121893 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 528/1058] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:47:51 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 15025 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:47:52.133691 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ef07c881-5a2b-431f-975d-53a47fd44357 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:52.134714 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ef07c881-5a2b-431f-975d-53a47fd44357 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:52.141408 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef07c881-5a2b-431f-975d-53a47fd44357 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:52.141844 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef07c881-5a2b-431f-975d-53a47fd44357 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:52.143146 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef07c881-5a2b-431f-975d-53a47fd44357 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:52.143575 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef07c881-5a2b-431f-975d-53a47fd44357 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:52.223163 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ef07c881-5a2b-431f-975d-53a47fd44357 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 18449 microversion: 2.20 time: 0.093129 Oct 28 08:47:52.223728 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 531/1059] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:47:52 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 18449 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:47:53.235280 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a65f99ac-fa76-4467-9cec-afd9b40210e5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:53.236388 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a65f99ac-fa76-4467-9cec-afd9b40210e5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:53.243612 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a65f99ac-fa76-4467-9cec-afd9b40210e5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:53.244095 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a65f99ac-fa76-4467-9cec-afd9b40210e5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:53.244886 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a65f99ac-fa76-4467-9cec-afd9b40210e5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:53.245318 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a65f99ac-fa76-4467-9cec-afd9b40210e5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:53.334767 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a65f99ac-fa76-4467-9cec-afd9b40210e5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 19342 microversion: 2.20 time: 0.103522 Oct 28 08:47:53.335725 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 529/1060] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:47:53 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 19342 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:47:54.348179 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cb172f71-d5a1-4251-a993-43fbde1dd563 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:54.349197 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cb172f71-d5a1-4251-a993-43fbde1dd563 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:54.356081 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb172f71-d5a1-4251-a993-43fbde1dd563 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:54.356549 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb172f71-d5a1-4251-a993-43fbde1dd563 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:54.357298 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb172f71-d5a1-4251-a993-43fbde1dd563 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:54.357731 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb172f71-d5a1-4251-a993-43fbde1dd563 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:54.430287 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cb172f71-d5a1-4251-a993-43fbde1dd563 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 21972 microversion: 2.20 time: 0.087010 Oct 28 08:47:54.430947 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 532/1061] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:47:54 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 21972 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:47:55.442412 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3e799b31-07bc-46d5-a2cc-af4d66457afa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:55.443341 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3e799b31-07bc-46d5-a2cc-af4d66457afa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:55.450082 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e799b31-07bc-46d5-a2cc-af4d66457afa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:55.450534 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e799b31-07bc-46d5-a2cc-af4d66457afa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:55.451428 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e799b31-07bc-46d5-a2cc-af4d66457afa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:55.451852 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e799b31-07bc-46d5-a2cc-af4d66457afa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:55.528466 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3e799b31-07bc-46d5-a2cc-af4d66457afa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 23235 microversion: 2.20 time: 0.090620 Oct 28 08:47:55.529111 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 530/1062] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:47:55 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 23235 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:47:56.541803 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c14fa6d6-b0fa-4d68-9d38-0ec05ea6d751 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:56.543523 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c14fa6d6-b0fa-4d68-9d38-0ec05ea6d751 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:56.552556 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c14fa6d6-b0fa-4d68-9d38-0ec05ea6d751 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:56.552998 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c14fa6d6-b0fa-4d68-9d38-0ec05ea6d751 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:56.554085 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c14fa6d6-b0fa-4d68-9d38-0ec05ea6d751 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:56.554542 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c14fa6d6-b0fa-4d68-9d38-0ec05ea6d751 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:56.636741 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c14fa6d6-b0fa-4d68-9d38-0ec05ea6d751 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 24617 microversion: 2.20 time: 0.099950 Oct 28 08:47:56.637458 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 533/1063] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:47:56 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 24617 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:47:57.649419 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-002779cf-a45f-4b83-b61c-49ea6efc8c01 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:57.650449 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-002779cf-a45f-4b83-b61c-49ea6efc8c01 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:57.657283 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-002779cf-a45f-4b83-b61c-49ea6efc8c01 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:57.657750 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-002779cf-a45f-4b83-b61c-49ea6efc8c01 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:57.658537 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-002779cf-a45f-4b83-b61c-49ea6efc8c01 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:57.658982 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-002779cf-a45f-4b83-b61c-49ea6efc8c01 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:57.897197 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-002779cf-a45f-4b83-b61c-49ea6efc8c01 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 26314 microversion: 2.20 time: 0.251683 Oct 28 08:47:57.897861 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 531/1064] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:47:57 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 26314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:47:58.909370 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ab8e5c7a-85a9-4d1a-affe-ebcd01e56cd3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:47:58.910399 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ab8e5c7a-85a9-4d1a-affe-ebcd01e56cd3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:47:58.917377 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab8e5c7a-85a9-4d1a-affe-ebcd01e56cd3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:58.917831 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab8e5c7a-85a9-4d1a-affe-ebcd01e56cd3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:58.918703 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab8e5c7a-85a9-4d1a-affe-ebcd01e56cd3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:47:58.919142 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab8e5c7a-85a9-4d1a-affe-ebcd01e56cd3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:47:59.000910 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ab8e5c7a-85a9-4d1a-affe-ebcd01e56cd3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 27159 microversion: 2.20 time: 0.096392 Oct 28 08:47:59.001571 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 534/1065] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:47:58 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 27159 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:00.013031 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-375e96c8-b52e-4114-a829-bc1cf83c03ce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:00.014029 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-375e96c8-b52e-4114-a829-bc1cf83c03ce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:00.021599 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-375e96c8-b52e-4114-a829-bc1cf83c03ce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:00.022039 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-375e96c8-b52e-4114-a829-bc1cf83c03ce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:00.022831 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-375e96c8-b52e-4114-a829-bc1cf83c03ce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:00.023265 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-375e96c8-b52e-4114-a829-bc1cf83c03ce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:00.102993 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-375e96c8-b52e-4114-a829-bc1cf83c03ce tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 27597 microversion: 2.20 time: 0.093799 Oct 28 08:48:00.103640 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 532/1066] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:00 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 27597 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:01.115222 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a453501d-79b7-480b-99df-2b5c15cb12cd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:01.116134 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a453501d-79b7-480b-99df-2b5c15cb12cd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:01.122963 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a453501d-79b7-480b-99df-2b5c15cb12cd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:01.123404 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a453501d-79b7-480b-99df-2b5c15cb12cd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:01.124171 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a453501d-79b7-480b-99df-2b5c15cb12cd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:01.124595 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a453501d-79b7-480b-99df-2b5c15cb12cd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:01.206487 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a453501d-79b7-480b-99df-2b5c15cb12cd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 27841 microversion: 2.20 time: 0.095881 Oct 28 08:48:01.207154 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 535/1067] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:01 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 27841 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:02.218363 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-57a27872-33d8-429c-a03b-e52f69e53867 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:02.219305 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-57a27872-33d8-429c-a03b-e52f69e53867 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:02.226176 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57a27872-33d8-429c-a03b-e52f69e53867 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:02.226650 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57a27872-33d8-429c-a03b-e52f69e53867 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:02.227417 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57a27872-33d8-429c-a03b-e52f69e53867 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:02.227843 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57a27872-33d8-429c-a03b-e52f69e53867 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:02.305460 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-57a27872-33d8-429c-a03b-e52f69e53867 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 27907 microversion: 2.20 time: 0.091309 Oct 28 08:48:02.306577 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 533/1068] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:02 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 27907 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:03.318599 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c04cbe86-0d2c-4237-bd56-6b05b010ec31 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:03.319598 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c04cbe86-0d2c-4237-bd56-6b05b010ec31 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:03.326729 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c04cbe86-0d2c-4237-bd56-6b05b010ec31 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:03.327176 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c04cbe86-0d2c-4237-bd56-6b05b010ec31 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:03.327956 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c04cbe86-0d2c-4237-bd56-6b05b010ec31 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:03.328421 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c04cbe86-0d2c-4237-bd56-6b05b010ec31 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:03.427998 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c04cbe86-0d2c-4237-bd56-6b05b010ec31 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28086 microversion: 2.20 time: 0.114290 Oct 28 08:48:03.428828 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 536/1069] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:03 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28086 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:04.439943 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-875765c5-5bc4-435c-9029-31f8a5150801 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:04.440942 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-875765c5-5bc4-435c-9029-31f8a5150801 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:04.447765 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-875765c5-5bc4-435c-9029-31f8a5150801 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:04.448215 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-875765c5-5bc4-435c-9029-31f8a5150801 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:04.448975 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-875765c5-5bc4-435c-9029-31f8a5150801 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:04.449407 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-875765c5-5bc4-435c-9029-31f8a5150801 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:04.525979 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-875765c5-5bc4-435c-9029-31f8a5150801 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28203 microversion: 2.20 time: 0.090443 Oct 28 08:48:04.526645 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 534/1070] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:04 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28203 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:05.538735 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bff09ead-4c30-4994-901d-ae201e9b87b3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:05.539663 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bff09ead-4c30-4994-901d-ae201e9b87b3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:05.546695 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bff09ead-4c30-4994-901d-ae201e9b87b3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:05.547145 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bff09ead-4c30-4994-901d-ae201e9b87b3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:05.548767 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bff09ead-4c30-4994-901d-ae201e9b87b3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:05.549439 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bff09ead-4c30-4994-901d-ae201e9b87b3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:05.612517 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bff09ead-4c30-4994-901d-ae201e9b87b3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28203 microversion: 2.20 time: 0.077744 Oct 28 08:48:05.613229 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 537/1071] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:05 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28203 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:06.624746 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c792509f-8fed-48a7-9069-c69029054fca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:06.626269 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c792509f-8fed-48a7-9069-c69029054fca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:06.633202 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c792509f-8fed-48a7-9069-c69029054fca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:06.633644 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c792509f-8fed-48a7-9069-c69029054fca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:06.634735 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c792509f-8fed-48a7-9069-c69029054fca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:06.634891 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c792509f-8fed-48a7-9069-c69029054fca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:06.697800 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c792509f-8fed-48a7-9069-c69029054fca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28203 microversion: 2.20 time: 0.077130 Oct 28 08:48:06.698701 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 535/1072] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:06 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28203 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:07.710934 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-72c1c2b5-fa6f-4888-90dc-bf93d5f8e1cc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:07.711988 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-72c1c2b5-fa6f-4888-90dc-bf93d5f8e1cc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:07.721007 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72c1c2b5-fa6f-4888-90dc-bf93d5f8e1cc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:07.721462 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72c1c2b5-fa6f-4888-90dc-bf93d5f8e1cc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:07.722244 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72c1c2b5-fa6f-4888-90dc-bf93d5f8e1cc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:07.722702 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72c1c2b5-fa6f-4888-90dc-bf93d5f8e1cc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:07.789053 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-72c1c2b5-fa6f-4888-90dc-bf93d5f8e1cc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28203 microversion: 2.20 time: 0.082071 Oct 28 08:48:07.792907 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 538/1073] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:07 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28203 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:07.812705 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-88fd32d6-1aa2-4e98-9533-a32301d09713 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:07.814350 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-88fd32d6-1aa2-4e98-9533-a32301d09713 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:07.821198 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88fd32d6-1aa2-4e98-9533-a32301d09713 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:07.821640 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88fd32d6-1aa2-4e98-9533-a32301d09713 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:07.822389 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88fd32d6-1aa2-4e98-9533-a32301d09713 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:07.822846 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88fd32d6-1aa2-4e98-9533-a32301d09713 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:07.857027 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-88fd32d6-1aa2-4e98-9533-a32301d09713 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048423 Oct 28 08:48:07.857581 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 536/1074] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Oct 28 08:48:07 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:48:07.914338 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0207ed8a-1d7d-4f07-b62a-af2232654255 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:07.914953 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0207ed8a-1d7d-4f07-b62a-af2232654255 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:07.921922 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0207ed8a-1d7d-4f07-b62a-af2232654255 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:07.922366 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0207ed8a-1d7d-4f07-b62a-af2232654255 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:07.923222 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0207ed8a-1d7d-4f07-b62a-af2232654255 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:07.923654 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0207ed8a-1d7d-4f07-b62a-af2232654255 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:07.950656 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0207ed8a-1d7d-4f07-b62a-af2232654255 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:48:08.026574 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0207ed8a-1d7d-4f07-b62a-af2232654255 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "DELETE /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 204 len: 0 microversion: 2.1 time: 0.115789 Oct 28 08:48:08.027528 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 539/1075] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Oct 28 08:48:07 2021] DELETE /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:48:08.036243 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bf11fa8c-c432-4b2c-810e-c318fc7d2d73 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:08.036852 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bf11fa8c-c432-4b2c-810e-c318fc7d2d73 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:08.042671 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf11fa8c-c432-4b2c-810e-c318fc7d2d73 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:08.043120 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf11fa8c-c432-4b2c-810e-c318fc7d2d73 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:08.043909 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf11fa8c-c432-4b2c-810e-c318fc7d2d73 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:08.044347 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf11fa8c-c432-4b2c-810e-c318fc7d2d73 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:08.171427 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-bf11fa8c-c432-4b2c-810e-c318fc7d2d73 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:08.179361 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bf11fa8c-c432-4b2c-810e-c318fc7d2d73 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1672 microversion: 2.1 time: 0.147441 Oct 28 08:48:08.179919 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 537/1076] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:08 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:08.801779 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-92bd225c-1e7c-400f-922e-a7e78f70c1f8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:08.802819 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-92bd225c-1e7c-400f-922e-a7e78f70c1f8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:08.809075 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92bd225c-1e7c-400f-922e-a7e78f70c1f8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:08.809512 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92bd225c-1e7c-400f-922e-a7e78f70c1f8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:08.810262 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92bd225c-1e7c-400f-922e-a7e78f70c1f8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:08.810734 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92bd225c-1e7c-400f-922e-a7e78f70c1f8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:08.873326 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-92bd225c-1e7c-400f-922e-a7e78f70c1f8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28203 microversion: 2.20 time: 0.076579 Oct 28 08:48:08.874234 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 540/1077] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:08 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28203 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:48:09.197221 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f906221d-dfe8-4de6-ae7d-8aeeec510b00 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:09.197827 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f906221d-dfe8-4de6-ae7d-8aeeec510b00 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:09.204599 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f906221d-dfe8-4de6-ae7d-8aeeec510b00 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:09.205054 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f906221d-dfe8-4de6-ae7d-8aeeec510b00 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:09.205818 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f906221d-dfe8-4de6-ae7d-8aeeec510b00 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:09.206254 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f906221d-dfe8-4de6-ae7d-8aeeec510b00 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:09.329557 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-f906221d-dfe8-4de6-ae7d-8aeeec510b00 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:09.336905 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f906221d-dfe8-4de6-ae7d-8aeeec510b00 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1672 microversion: 2.1 time: 0.143339 Oct 28 08:48:09.337460 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 538/1078] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:09 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1672 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:09.885938 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d721dc96-8cef-494f-9128-3f165ce54dd3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:09.886969 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d721dc96-8cef-494f-9128-3f165ce54dd3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:09.894934 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d721dc96-8cef-494f-9128-3f165ce54dd3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:09.895709 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d721dc96-8cef-494f-9128-3f165ce54dd3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:09.897098 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d721dc96-8cef-494f-9128-3f165ce54dd3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:09.897552 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d721dc96-8cef-494f-9128-3f165ce54dd3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:09.983547 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d721dc96-8cef-494f-9128-3f165ce54dd3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28203 microversion: 2.20 time: 0.101507 Oct 28 08:48:09.985818 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 541/1079] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:09 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28203 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:10.354265 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a67ae781-f059-46b8-bcdc-182136f18cec tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:10.354986 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a67ae781-f059-46b8-bcdc-182136f18cec tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:10.363093 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a67ae781-f059-46b8-bcdc-182136f18cec tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:10.363633 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a67ae781-f059-46b8-bcdc-182136f18cec tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:10.364483 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a67ae781-f059-46b8-bcdc-182136f18cec tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:10.364981 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a67ae781-f059-46b8-bcdc-182136f18cec tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:10.448128 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-a67ae781-f059-46b8-bcdc-182136f18cec tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:10.457052 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a67ae781-f059-46b8-bcdc-182136f18cec tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 200 len: 1605 microversion: 2.1 time: 0.106402 Oct 28 08:48:10.457626 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 539/1080] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:10 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 1605 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:10.536552 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-dc4f38bb-78d5-433e-833b-043c74e21ec1 req-1fb389a0-694d-4496-8f9e-de726b23593e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "914cd123-e872-418a-bf38-f477fe1551b3", "name": "network-vif-deleted", "tag": "bc82b34a-5083-4fe6-8ca3-57d3482a7509"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:10.538104 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:48:10.538104 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:48:10.546323 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-dc4f38bb-78d5-433e-833b-043c74e21ec1 req-1fb389a0-694d-4496-8f9e-de726b23593e service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:10.546874 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-dc4f38bb-78d5-433e-833b-043c74e21ec1 req-1fb389a0-694d-4496-8f9e-de726b23593e service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:10.559122 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-dc4f38bb-78d5-433e-833b-043c74e21ec1 req-1fb389a0-694d-4496-8f9e-de726b23593e service nova] Creating event network-vif-deleted:bc82b34a-5083-4fe6-8ca3-57d3482a7509 for instance 914cd123-e872-418a-bf38-f477fe1551b3 on hv-cinder-81565 Oct 28 08:48:10.564337 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-dc4f38bb-78d5-433e-833b-043c74e21ec1 req-1fb389a0-694d-4496-8f9e-de726b23593e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033078 Oct 28 08:48:10.565179 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 542/1081] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:48:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:48:10.996508 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-00272393-feff-4a65-aa96-525fd6666cd3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:10.997883 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-00272393-feff-4a65-aa96-525fd6666cd3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:11.005189 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00272393-feff-4a65-aa96-525fd6666cd3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:11.005993 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00272393-feff-4a65-aa96-525fd6666cd3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:11.006800 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00272393-feff-4a65-aa96-525fd6666cd3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:11.007378 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00272393-feff-4a65-aa96-525fd6666cd3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:11.069571 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-00272393-feff-4a65-aa96-525fd6666cd3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28203 microversion: 2.20 time: 0.076746 Oct 28 08:48:11.070254 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 540/1082] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:10 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28203 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:11.475471 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2da4d3a9-dde1-4b7b-9d9a-d600943f2dea tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:11.476167 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2da4d3a9-dde1-4b7b-9d9a-d600943f2dea tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:11.482130 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2da4d3a9-dde1-4b7b-9d9a-d600943f2dea tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:11.482608 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2da4d3a9-dde1-4b7b-9d9a-d600943f2dea tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:11.483423 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2da4d3a9-dde1-4b7b-9d9a-d600943f2dea tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:11.483889 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2da4d3a9-dde1-4b7b-9d9a-d600943f2dea tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:11.498467 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-2da4d3a9-dde1-4b7b-9d9a-d600943f2dea tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] HTTP exception thrown: Instance 914cd123-e872-418a-bf38-f477fe1551b3 could not be found. Oct 28 08:48:11.499087 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2da4d3a9-dde1-4b7b-9d9a-d600943f2dea tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Returning 404 to user: Instance 914cd123-e872-418a-bf38-f477fe1551b3 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:48:11.499923 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2da4d3a9-dde1-4b7b-9d9a-d600943f2dea tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 404 len: 111 microversion: 2.1 time: 0.028989 Oct 28 08:48:11.500482 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 543/1083] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:11 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:48:11.510590 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cc18638f-ab65-4516-bcbc-a7fcd6d9ed75 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '.version_select at 0x7fed6e906a60>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:11.531155 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cc18638f-ab65-4516-bcbc-a7fcd6d9ed75 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1089437154" status: 202 len: 0 microversion: 2.1 time: 0.024715 Oct 28 08:48:11.531873 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 541/1084] 10.222.0.76 () {58 vars in 1220 bytes} [Thu Oct 28 08:48:11 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1089437154 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:48:12.081512 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ca228d3a-efd9-4c5b-aeab-ef837f229deb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:12.082440 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ca228d3a-efd9-4c5b-aeab-ef837f229deb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:12.090527 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca228d3a-efd9-4c5b-aeab-ef837f229deb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:12.091182 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca228d3a-efd9-4c5b-aeab-ef837f229deb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:12.091980 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca228d3a-efd9-4c5b-aeab-ef837f229deb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:12.092416 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca228d3a-efd9-4c5b-aeab-ef837f229deb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:12.157941 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ca228d3a-efd9-4c5b-aeab-ef837f229deb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28203 microversion: 2.20 time: 0.080516 Oct 28 08:48:12.159504 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 544/1085] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:12 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28203 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:12.300556 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f9275fc5-e119-4138-bc71-0a66bafdaff4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'create', calling method: .version_select at 0x7fed6e94a790>, body: {"keypair": {"name": "tempest-keypair-841147689"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:12.319642 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-f9275fc5-e119-4138-bc71-0a66bafdaff4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Getting quotas for project d12dfed3afe746b58b897b104b2a78ae. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:48:12.323825 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-f9275fc5-e119-4138-bc71-0a66bafdaff4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Getting quotas for user 483af16bae1f4521ad3e3138bbc86123 and project d12dfed3afe746b58b897b104b2a78ae. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:48:12.467173 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-f9275fc5-e119-4138-bc71-0a66bafdaff4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Getting quotas for project d12dfed3afe746b58b897b104b2a78ae. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:48:12.471626 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-f9275fc5-e119-4138-bc71-0a66bafdaff4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Getting quotas for user 483af16bae1f4521ad3e3138bbc86123 and project d12dfed3afe746b58b897b104b2a78ae. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:48:12.486692 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f9275fc5-e119-4138-bc71-0a66bafdaff4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.190799 Oct 28 08:48:12.487325 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 542/1086] 10.222.0.76 () {60 vars in 1157 bytes} [Thu Oct 28 08:48:12 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:48:13.170730 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ecf9db03-4c24-44e3-9fee-1648b26d5425 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:13.171740 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ecf9db03-4c24-44e3-9fee-1648b26d5425 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:13.179284 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ecf9db03-4c24-44e3-9fee-1648b26d5425 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:13.179776 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ecf9db03-4c24-44e3-9fee-1648b26d5425 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:13.180509 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ecf9db03-4c24-44e3-9fee-1648b26d5425 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:13.180882 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ecf9db03-4c24-44e3-9fee-1648b26d5425 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:13.241253 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ecf9db03-4c24-44e3-9fee-1648b26d5425 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28203 microversion: 2.20 time: 0.074123 Oct 28 08:48:13.242010 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 545/1087] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:13 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28203 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:13.760380 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-49f9bf35-d6f3-455c-bb92-0039f48873b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1694452735", "imageRef": "339e99be-6a19-4324-aa16-6b690c25dede", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "35511921-4507-4196-b423-3f07547df75c"}], "security_groups": [{"name": "tempest-securitygroup--1615672169"}], "key_name": "tempest-keypair-841147689", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:13.860702 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-49f9bf35-d6f3-455c-bb92-0039f48873b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] validate_networks() for [('35511921-4507-4196-b423-3f07547df75c', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:48:14.221103 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 08:48:14.221672 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: Thu Oct 28 08:48:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 08:48:14.237484 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-49f9bf35-d6f3-455c-bb92-0039f48873b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:48:14.237903 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-49f9bf35-d6f3-455c-bb92-0039f48873b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:48:14.238403 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-49f9bf35-d6f3-455c-bb92-0039f48873b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:48:14.238853 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-49f9bf35-d6f3-455c-bb92-0039f48873b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:48:14.239267 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-49f9bf35-d6f3-455c-bb92-0039f48873b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:48:14.247843 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49f9bf35-d6f3-455c-bb92-0039f48873b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:14.248291 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49f9bf35-d6f3-455c-bb92-0039f48873b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:14.249094 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49f9bf35-d6f3-455c-bb92-0039f48873b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:14.249530 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49f9bf35-d6f3-455c-bb92-0039f48873b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:14.253477 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a05ed9aa-dbd7-4c13-8633-ba26b9cb2f22 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:14.254470 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a05ed9aa-dbd7-4c13-8633-ba26b9cb2f22 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:14.261237 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a05ed9aa-dbd7-4c13-8633-ba26b9cb2f22 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:14.261676 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a05ed9aa-dbd7-4c13-8633-ba26b9cb2f22 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:14.262438 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a05ed9aa-dbd7-4c13-8633-ba26b9cb2f22 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:14.262924 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a05ed9aa-dbd7-4c13-8633-ba26b9cb2f22 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:14.265803 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-49f9bf35-d6f3-455c-bb92-0039f48873b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Getting quotas for project d12dfed3afe746b58b897b104b2a78ae. Resources: {'instances', 'cores', 'ram'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:48:14.269905 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-49f9bf35-d6f3-455c-bb92-0039f48873b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Getting quotas for user 483af16bae1f4521ad3e3138bbc86123 and project d12dfed3afe746b58b897b104b2a78ae. Resources: {'instances', 'cores', 'ram'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:48:14.280797 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-49f9bf35-d6f3-455c-bb92-0039f48873b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:48:14.283829 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-49f9bf35-d6f3-455c-bb92-0039f48873b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='339e99be-6a19-4324-aa16-6b690c25dede',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:48:14.325394 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a05ed9aa-dbd7-4c13-8633-ba26b9cb2f22 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28203 microversion: 2.20 time: 0.076268 Oct 28 08:48:14.326180 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 546/1088] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:14 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28203 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:48:14.329494 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-49f9bf35-d6f3-455c-bb92-0039f48873b7 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.573394 Oct 28 08:48:14.330250 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 543/1089] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Oct 28 08:48:13 2021] POST /compute/v2.1/servers => generated 402 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:48:14.340759 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f4160d94-09c6-4aa0-871d-90668147839f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:14.341448 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f4160d94-09c6-4aa0-871d-90668147839f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:14.396634 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-f4160d94-09c6-4aa0-871d-90668147839f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:14.403032 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f4160d94-09c6-4aa0-871d-90668147839f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae" status: 200 len: 1237 microversion: 2.1 time: 0.066473 Oct 28 08:48:14.403572 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 547/1090] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:14 2021] GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:15.338282 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-abf75dca-70b5-4283-be70-77782155c813 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:15.339282 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-abf75dca-70b5-4283-be70-77782155c813 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:15.346652 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-abf75dca-70b5-4283-be70-77782155c813 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:15.347107 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-abf75dca-70b5-4283-be70-77782155c813 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:15.347877 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-abf75dca-70b5-4283-be70-77782155c813 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:15.348369 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-abf75dca-70b5-4283-be70-77782155c813 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:15.409753 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-abf75dca-70b5-4283-be70-77782155c813 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28203 microversion: 2.20 time: 0.075471 Oct 28 08:48:15.410420 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 544/1091] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:15 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28203 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:15.420596 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-16a3f058-a961-4bc5-801b-fea9ed98ec05 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:15.421305 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-16a3f058-a961-4bc5-801b-fea9ed98ec05 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:15.481086 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-16a3f058-a961-4bc5-801b-fea9ed98ec05 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:15.488241 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-16a3f058-a961-4bc5-801b-fea9ed98ec05 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae" status: 200 len: 1237 microversion: 2.1 time: 0.071417 Oct 28 08:48:15.488887 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 548/1092] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:15 2021] GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:16.421701 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2f69bdd6-f83c-4558-af73-b5343d4d351f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:16.422948 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2f69bdd6-f83c-4558-af73-b5343d4d351f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:16.429704 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f69bdd6-f83c-4558-af73-b5343d4d351f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:16.430152 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f69bdd6-f83c-4558-af73-b5343d4d351f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:16.430954 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f69bdd6-f83c-4558-af73-b5343d4d351f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:16.431387 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f69bdd6-f83c-4558-af73-b5343d4d351f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:16.493873 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2f69bdd6-f83c-4558-af73-b5343d4d351f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28203 microversion: 2.20 time: 0.076028 Oct 28 08:48:16.494520 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 545/1093] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:16 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28203 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:16.505292 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-65e4faff-01a8-400d-a4d2-ff5d63642fa5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:16.505886 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-65e4faff-01a8-400d-a4d2-ff5d63642fa5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:16.559341 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-65e4faff-01a8-400d-a4d2-ff5d63642fa5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:16.567284 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-65e4faff-01a8-400d-a4d2-ff5d63642fa5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae" status: 200 len: 1237 microversion: 2.1 time: 0.065645 Oct 28 08:48:16.567886 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 549/1094] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:16 2021] GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:17.510001 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c0b5f0f0-90e3-4c1d-8c7e-0a795ddb7935 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:17.511199 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c0b5f0f0-90e3-4c1d-8c7e-0a795ddb7935 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:17.519851 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0b5f0f0-90e3-4c1d-8c7e-0a795ddb7935 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:17.520302 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0b5f0f0-90e3-4c1d-8c7e-0a795ddb7935 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:17.521213 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0b5f0f0-90e3-4c1d-8c7e-0a795ddb7935 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:17.521649 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0b5f0f0-90e3-4c1d-8c7e-0a795ddb7935 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:17.587564 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b780a033-826b-4f1a-b89f-7eeb7ec1f209 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:17.588600 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b780a033-826b-4f1a-b89f-7eeb7ec1f209 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:17.593698 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c0b5f0f0-90e3-4c1d-8c7e-0a795ddb7935 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28203 microversion: 2.20 time: 0.087638 Oct 28 08:48:17.599172 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 546/1095] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:17 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28203 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:17.600831 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b780a033-826b-4f1a-b89f-7eeb7ec1f209 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:17.601297 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b780a033-826b-4f1a-b89f-7eeb7ec1f209 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:17.602077 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b780a033-826b-4f1a-b89f-7eeb7ec1f209 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:17.602530 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b780a033-826b-4f1a-b89f-7eeb7ec1f209 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:17.697952 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-b780a033-826b-4f1a-b89f-7eeb7ec1f209 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:17.707914 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b780a033-826b-4f1a-b89f-7eeb7ec1f209 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae" status: 200 len: 1295 microversion: 2.1 time: 0.126872 Oct 28 08:48:17.708344 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 550/1096] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:17 2021] GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae => generated 1295 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:18.607858 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0ecbfb27-78c5-43ce-823e-1e9ecaaeb519 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:18.608920 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0ecbfb27-78c5-43ce-823e-1e9ecaaeb519 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:18.620221 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ecbfb27-78c5-43ce-823e-1e9ecaaeb519 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:18.620657 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ecbfb27-78c5-43ce-823e-1e9ecaaeb519 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:18.621577 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ecbfb27-78c5-43ce-823e-1e9ecaaeb519 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:18.622039 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ecbfb27-78c5-43ce-823e-1e9ecaaeb519 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:18.697570 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0ecbfb27-78c5-43ce-823e-1e9ecaaeb519 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28494 microversion: 2.20 time: 0.093944 Oct 28 08:48:18.698688 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 547/1097] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:18 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28494 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:18.724888 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-503dbd01-317a-45a0-9145-19d69059018b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:18.725590 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-503dbd01-317a-45a0-9145-19d69059018b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:18.731649 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-503dbd01-317a-45a0-9145-19d69059018b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:18.732092 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-503dbd01-317a-45a0-9145-19d69059018b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:18.732874 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-503dbd01-317a-45a0-9145-19d69059018b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:18.733300 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-503dbd01-317a-45a0-9145-19d69059018b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:18.938763 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-74a0fc35-4a04-4731-a8d0-99f66d719f1c req-2243d24b-cc8b-4e5e-a81a-54f6398bbf33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7b330ee-3ee9-48ec-bd24-81e216ae78ae", "tag": "d06f77e6-19cf-4197-85ed-4921523a9bd2"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:18.940551 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:48:18.940551 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:48:18.949410 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-74a0fc35-4a04-4731-a8d0-99f66d719f1c req-2243d24b-cc8b-4e5e-a81a-54f6398bbf33 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:18.950133 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-74a0fc35-4a04-4731-a8d0-99f66d719f1c req-2243d24b-cc8b-4e5e-a81a-54f6398bbf33 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:18.961603 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-74a0fc35-4a04-4731-a8d0-99f66d719f1c req-2243d24b-cc8b-4e5e-a81a-54f6398bbf33 service nova] Creating event network-changed:d06f77e6-19cf-4197-85ed-4921523a9bd2 for instance e7b330ee-3ee9-48ec-bd24-81e216ae78ae on hv-cinder-81565 Oct 28 08:48:18.966859 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-74a0fc35-4a04-4731-a8d0-99f66d719f1c req-2243d24b-cc8b-4e5e-a81a-54f6398bbf33 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032038 Oct 28 08:48:18.967452 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 548/1098] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:48:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:48:18.972048 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-503dbd01-317a-45a0-9145-19d69059018b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:18.981856 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-503dbd01-317a-45a0-9145-19d69059018b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae" status: 200 len: 1363 microversion: 2.1 time: 0.260495 Oct 28 08:48:18.982778 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 551/1099] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:18 2021] GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:19.710751 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6ab3a95f-1109-4d39-b0b1-f2c1fa030fd8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:19.711741 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6ab3a95f-1109-4d39-b0b1-f2c1fa030fd8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:19.718122 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ab3a95f-1109-4d39-b0b1-f2c1fa030fd8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:19.718516 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ab3a95f-1109-4d39-b0b1-f2c1fa030fd8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:19.719866 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ab3a95f-1109-4d39-b0b1-f2c1fa030fd8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:19.720297 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ab3a95f-1109-4d39-b0b1-f2c1fa030fd8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:19.779092 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6ab3a95f-1109-4d39-b0b1-f2c1fa030fd8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28494 microversion: 2.20 time: 0.072673 Oct 28 08:48:19.779734 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 549/1100] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:19 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28494 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:19.999912 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-655e224e-3cba-474e-aaee-8c487a7fee9a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:20.001051 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-655e224e-3cba-474e-aaee-8c487a7fee9a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:20.008151 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-655e224e-3cba-474e-aaee-8c487a7fee9a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:20.008596 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-655e224e-3cba-474e-aaee-8c487a7fee9a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:20.009382 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-655e224e-3cba-474e-aaee-8c487a7fee9a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:20.009811 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-655e224e-3cba-474e-aaee-8c487a7fee9a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:20.195285 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-655e224e-3cba-474e-aaee-8c487a7fee9a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:20.202694 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-655e224e-3cba-474e-aaee-8c487a7fee9a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae" status: 200 len: 1363 microversion: 2.1 time: 0.206493 Oct 28 08:48:20.203256 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 552/1101] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:19 2021] GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:20.792235 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-813a15ad-3912-4cb7-8a8f-94f7531ce0a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:20.793258 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-813a15ad-3912-4cb7-8a8f-94f7531ce0a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:20.800226 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-813a15ad-3912-4cb7-8a8f-94f7531ce0a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:20.800666 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-813a15ad-3912-4cb7-8a8f-94f7531ce0a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:20.801435 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-813a15ad-3912-4cb7-8a8f-94f7531ce0a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:20.801898 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-813a15ad-3912-4cb7-8a8f-94f7531ce0a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:20.932528 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-813a15ad-3912-4cb7-8a8f-94f7531ce0a3 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.144161 Oct 28 08:48:20.933207 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 550/1102] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:20 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:21.221084 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ce2a1e4d-996b-4c57-b52f-46a80706e617 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:21.221962 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ce2a1e4d-996b-4c57-b52f-46a80706e617 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:21.228141 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce2a1e4d-996b-4c57-b52f-46a80706e617 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:21.228844 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce2a1e4d-996b-4c57-b52f-46a80706e617 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:21.229603 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce2a1e4d-996b-4c57-b52f-46a80706e617 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:21.230027 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce2a1e4d-996b-4c57-b52f-46a80706e617 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:21.352862 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-ce2a1e4d-996b-4c57-b52f-46a80706e617 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:21.360069 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ce2a1e4d-996b-4c57-b52f-46a80706e617 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae" status: 200 len: 1363 microversion: 2.1 time: 0.144135 Oct 28 08:48:21.360632 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 553/1103] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:21 2021] GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:21.944803 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-12172b0d-afdd-4e93-9cda-10a847b4bed8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:21.945794 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-12172b0d-afdd-4e93-9cda-10a847b4bed8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:21.952535 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12172b0d-afdd-4e93-9cda-10a847b4bed8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:21.952970 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12172b0d-afdd-4e93-9cda-10a847b4bed8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:21.954226 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12172b0d-afdd-4e93-9cda-10a847b4bed8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:21.954690 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12172b0d-afdd-4e93-9cda-10a847b4bed8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:22.016777 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-12172b0d-afdd-4e93-9cda-10a847b4bed8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.075261 Oct 28 08:48:22.017426 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 551/1104] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:21 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:48:22.377721 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3a9f462a-307d-4a79-81d2-774bd834f482 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:22.378332 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3a9f462a-307d-4a79-81d2-774bd834f482 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:22.384642 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a9f462a-307d-4a79-81d2-774bd834f482 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:22.385096 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a9f462a-307d-4a79-81d2-774bd834f482 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:22.385872 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a9f462a-307d-4a79-81d2-774bd834f482 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:22.386304 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a9f462a-307d-4a79-81d2-774bd834f482 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:22.516557 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3a9f462a-307d-4a79-81d2-774bd834f482 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:22.523823 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3a9f462a-307d-4a79-81d2-774bd834f482 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae" status: 200 len: 1363 microversion: 2.1 time: 0.150529 Oct 28 08:48:22.524384 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 554/1105] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:22 2021] GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:23.029033 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0b012a83-347f-4d42-8a7e-3e037da23119 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:23.030027 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0b012a83-347f-4d42-8a7e-3e037da23119 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:23.037593 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b012a83-347f-4d42-8a7e-3e037da23119 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:23.038068 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b012a83-347f-4d42-8a7e-3e037da23119 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:23.038881 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b012a83-347f-4d42-8a7e-3e037da23119 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:23.039321 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b012a83-347f-4d42-8a7e-3e037da23119 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:23.112553 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0b012a83-347f-4d42-8a7e-3e037da23119 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.087410 Oct 28 08:48:23.113191 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 552/1106] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:23 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:48:23.541612 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-58818819-402c-4db5-bbe2-bad896caa566 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:23.542222 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-58818819-402c-4db5-bbe2-bad896caa566 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:23.548801 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58818819-402c-4db5-bbe2-bad896caa566 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:23.549248 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58818819-402c-4db5-bbe2-bad896caa566 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:23.550045 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58818819-402c-4db5-bbe2-bad896caa566 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:23.550478 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58818819-402c-4db5-bbe2-bad896caa566 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:23.676732 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-58818819-402c-4db5-bbe2-bad896caa566 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:23.684012 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-58818819-402c-4db5-bbe2-bad896caa566 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae" status: 200 len: 1363 microversion: 2.1 time: 0.146077 Oct 28 08:48:23.684567 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 555/1107] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:23 2021] GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:24.124708 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-24339ee2-7a55-4680-829c-5b54a5efc11b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:24.125998 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-24339ee2-7a55-4680-829c-5b54a5efc11b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:24.132861 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24339ee2-7a55-4680-829c-5b54a5efc11b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:24.133308 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24339ee2-7a55-4680-829c-5b54a5efc11b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:24.134116 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24339ee2-7a55-4680-829c-5b54a5efc11b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:24.134573 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24339ee2-7a55-4680-829c-5b54a5efc11b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:24.186032 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-b632a475-45f2-45c8-8605-d57bd7104c4b req-07bd591b-8517-4496-a8cc-0d5c6cc55630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7b330ee-3ee9-48ec-bd24-81e216ae78ae", "name": "network-vif-plugged", "status": "completed", "tag": "d06f77e6-19cf-4197-85ed-4921523a9bd2"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:24.187669 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:48:24.187669 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:48:24.194842 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b632a475-45f2-45c8-8605-d57bd7104c4b req-07bd591b-8517-4496-a8cc-0d5c6cc55630 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:24.195265 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b632a475-45f2-45c8-8605-d57bd7104c4b req-07bd591b-8517-4496-a8cc-0d5c6cc55630 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:24.206275 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-24339ee2-7a55-4680-829c-5b54a5efc11b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.085551 Oct 28 08:48:24.210261 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-b632a475-45f2-45c8-8605-d57bd7104c4b req-07bd591b-8517-4496-a8cc-0d5c6cc55630 service nova] Creating event network-vif-plugged:d06f77e6-19cf-4197-85ed-4921523a9bd2 for instance e7b330ee-3ee9-48ec-bd24-81e216ae78ae on hv-cinder-81565 Oct 28 08:48:24.210397 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 553/1108] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:24 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:24.212282 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-b632a475-45f2-45c8-8605-d57bd7104c4b req-07bd591b-8517-4496-a8cc-0d5c6cc55630 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029766 Oct 28 08:48:24.212868 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 556/1109] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:48:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:48:24.412882 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c328b29b-0134-4d20-b327-d08d996e6425 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:24.413584 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c328b29b-0134-4d20-b327-d08d996e6425 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:24.420331 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c328b29b-0134-4d20-b327-d08d996e6425 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:24.421014 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c328b29b-0134-4d20-b327-d08d996e6425 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:24.421774 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c328b29b-0134-4d20-b327-d08d996e6425 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:24.422750 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c328b29b-0134-4d20-b327-d08d996e6425 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:24.445936 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-c328b29b-0134-4d20-b327-d08d996e6425 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lazy-loading 'flavor' on Instance uuid de3329c3-6608-4f3d-a14e-a1c563567ca1 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:48:24.519475 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c328b29b-0134-4d20-b327-d08d996e6425 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "POST /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1/action" status: 202 len: 0 microversion: 2.1 time: 0.110482 Oct 28 08:48:24.519963 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 554/1110] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:24 2021] POST /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:24.528453 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2f6624ce-3c1f-418a-8a6d-8855f40c45f5 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:24.529134 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2f6624ce-3c1f-418a-8a6d-8855f40c45f5 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:24.536388 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f6624ce-3c1f-418a-8a6d-8855f40c45f5 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:24.536829 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f6624ce-3c1f-418a-8a6d-8855f40c45f5 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:24.537583 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f6624ce-3c1f-418a-8a6d-8855f40c45f5 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:24.538003 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f6624ce-3c1f-418a-8a6d-8855f40c45f5 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:24.663858 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-2f6624ce-3c1f-418a-8a6d-8855f40c45f5 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:24.671260 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2f6624ce-3c1f-418a-8a6d-8855f40c45f5 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1569 microversion: 2.1 time: 0.146796 Oct 28 08:48:24.671818 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 557/1111] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:24 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:24.701836 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d43ad974-7fd2-4215-9f0f-52998ded2c1b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:24.702574 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d43ad974-7fd2-4215-9f0f-52998ded2c1b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:24.709291 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d43ad974-7fd2-4215-9f0f-52998ded2c1b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:24.709764 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d43ad974-7fd2-4215-9f0f-52998ded2c1b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:24.710549 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d43ad974-7fd2-4215-9f0f-52998ded2c1b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:24.710978 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d43ad974-7fd2-4215-9f0f-52998ded2c1b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:24.837388 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-d43ad974-7fd2-4215-9f0f-52998ded2c1b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:24.845373 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d43ad974-7fd2-4215-9f0f-52998ded2c1b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae" status: 200 len: 1363 microversion: 2.1 time: 0.148009 Oct 28 08:48:24.845930 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 555/1112] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:24 2021] GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:25.218239 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-89cd99dc-136e-438f-bfbf-fcb3f5e09f17 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:25.219175 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-89cd99dc-136e-438f-bfbf-fcb3f5e09f17 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:25.225320 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89cd99dc-136e-438f-bfbf-fcb3f5e09f17 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:25.225765 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89cd99dc-136e-438f-bfbf-fcb3f5e09f17 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:25.226562 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89cd99dc-136e-438f-bfbf-fcb3f5e09f17 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:25.227106 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89cd99dc-136e-438f-bfbf-fcb3f5e09f17 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:25.347588 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-89cd99dc-136e-438f-bfbf-fcb3f5e09f17 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.133075 Oct 28 08:48:25.348211 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 558/1113] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:25 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:25.688827 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b7d423e6-30ad-4317-a604-90e37077cdeb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:25.689358 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b7d423e6-30ad-4317-a604-90e37077cdeb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:25.695614 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7d423e6-30ad-4317-a604-90e37077cdeb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:25.696058 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7d423e6-30ad-4317-a604-90e37077cdeb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:25.696911 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7d423e6-30ad-4317-a604-90e37077cdeb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:25.697484 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7d423e6-30ad-4317-a604-90e37077cdeb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:25.816620 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-b7d423e6-30ad-4317-a604-90e37077cdeb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:25.824948 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b7d423e6-30ad-4317-a604-90e37077cdeb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1569 microversion: 2.1 time: 0.139098 Oct 28 08:48:25.824948 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 556/1114] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:25 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:25.862839 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-122374b3-a831-4404-bc49-bc473823e366 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:25.863534 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-122374b3-a831-4404-bc49-bc473823e366 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:25.870422 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-122374b3-a831-4404-bc49-bc473823e366 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:25.870892 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-122374b3-a831-4404-bc49-bc473823e366 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:25.871660 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-122374b3-a831-4404-bc49-bc473823e366 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:25.872097 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-122374b3-a831-4404-bc49-bc473823e366 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:26.005725 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-122374b3-a831-4404-bc49-bc473823e366 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:26.013336 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-122374b3-a831-4404-bc49-bc473823e366 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae" status: 200 len: 1363 microversion: 2.1 time: 0.154874 Oct 28 08:48:26.013891 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 559/1115] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:25 2021] GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:48:26.359290 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-72750d0b-fad0-46b1-9d6d-cd060d5697aa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:26.360491 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-72750d0b-fad0-46b1-9d6d-cd060d5697aa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:26.367469 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-72750d0b-fad0-46b1-9d6d-cd060d5697aa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:26.367917 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-72750d0b-fad0-46b1-9d6d-cd060d5697aa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:26.368973 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-72750d0b-fad0-46b1-9d6d-cd060d5697aa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:26.369411 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-72750d0b-fad0-46b1-9d6d-cd060d5697aa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:26.435371 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-72750d0b-fad0-46b1-9d6d-cd060d5697aa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.079790 Oct 28 08:48:26.436005 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 557/1116] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:26 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:48:26.841301 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-63275751-1399-41ea-af95-daa4d9644b4a tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:26.841938 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-63275751-1399-41ea-af95-daa4d9644b4a tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:26.848655 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63275751-1399-41ea-af95-daa4d9644b4a tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:26.849102 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63275751-1399-41ea-af95-daa4d9644b4a tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:26.849857 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63275751-1399-41ea-af95-daa4d9644b4a tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:26.850291 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63275751-1399-41ea-af95-daa4d9644b4a tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:26.971185 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-63275751-1399-41ea-af95-daa4d9644b4a tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:26.978725 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-63275751-1399-41ea-af95-daa4d9644b4a tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1569 microversion: 2.1 time: 0.141295 Oct 28 08:48:26.979323 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 560/1117] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:26 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1569 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:27.031641 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0dff2ae1-75e9-4ba4-b77c-091fff314100 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:27.032735 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0dff2ae1-75e9-4ba4-b77c-091fff314100 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:27.039062 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0dff2ae1-75e9-4ba4-b77c-091fff314100 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:27.039507 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0dff2ae1-75e9-4ba4-b77c-091fff314100 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:27.040277 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0dff2ae1-75e9-4ba4-b77c-091fff314100 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:27.040804 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0dff2ae1-75e9-4ba4-b77c-091fff314100 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:27.164843 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-0dff2ae1-75e9-4ba4-b77c-091fff314100 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:27.173164 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0dff2ae1-75e9-4ba4-b77c-091fff314100 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae" status: 200 len: 1548 microversion: 2.1 time: 0.145972 Oct 28 08:48:27.173728 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 558/1118] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:27 2021] GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae => generated 1548 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:27.189679 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ea592434-76dd-4928-9a0b-bba10eabb9e8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:27.190202 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ea592434-76dd-4928-9a0b-bba10eabb9e8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:27.196484 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea592434-76dd-4928-9a0b-bba10eabb9e8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:27.196920 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea592434-76dd-4928-9a0b-bba10eabb9e8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:27.197686 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea592434-76dd-4928-9a0b-bba10eabb9e8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:27.198114 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea592434-76dd-4928-9a0b-bba10eabb9e8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:27.280385 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ea592434-76dd-4928-9a0b-bba10eabb9e8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094860 Oct 28 08:48:27.280975 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 561/1119] 10.222.0.76 () {58 vars in 1274 bytes} [Thu Oct 28 08:48:27 2021] GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:48:27.447496 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d1fc3488-7493-4fe6-a480-72d0774517e6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:27.448319 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d1fc3488-7493-4fe6-a480-72d0774517e6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:27.455522 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d1fc3488-7493-4fe6-a480-72d0774517e6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:27.455966 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d1fc3488-7493-4fe6-a480-72d0774517e6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:27.456730 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d1fc3488-7493-4fe6-a480-72d0774517e6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:27.457149 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d1fc3488-7493-4fe6-a480-72d0774517e6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:27.519770 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d1fc3488-7493-4fe6-a480-72d0774517e6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.075871 Oct 28 08:48:27.520422 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 559/1120] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:27 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:27.997290 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ea70488c-a619-4589-aaad-bc5d8d7e9c8a tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:27.997894 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ea70488c-a619-4589-aaad-bc5d8d7e9c8a tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:28.004633 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea70488c-a619-4589-aaad-bc5d8d7e9c8a tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:28.005075 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea70488c-a619-4589-aaad-bc5d8d7e9c8a tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:28.005930 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea70488c-a619-4589-aaad-bc5d8d7e9c8a tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:28.006411 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea70488c-a619-4589-aaad-bc5d8d7e9c8a tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:28.220137 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-ea70488c-a619-4589-aaad-bc5d8d7e9c8a tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:28.227354 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ea70488c-a619-4589-aaad-bc5d8d7e9c8a tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1569 microversion: 2.1 time: 0.234180 Oct 28 08:48:28.227919 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 562/1121] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:27 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1569 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:28.283730 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5a6b0c06-81a4-46d2-8c55-109b4efd2d7a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:28.284906 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5a6b0c06-81a4-46d2-8c55-109b4efd2d7a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:28.286531 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-bb3681ca-1c61-42a4-876d-44399866bedc req-1836acd6-b3ae-4797-ba12-ea895c3d8b08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7b330ee-3ee9-48ec-bd24-81e216ae78ae", "tag": "d06f77e6-19cf-4197-85ed-4921523a9bd2"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:28.288193 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:48:28.288193 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:48:28.292324 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a6b0c06-81a4-46d2-8c55-109b4efd2d7a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:28.292807 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a6b0c06-81a4-46d2-8c55-109b4efd2d7a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:28.293620 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a6b0c06-81a4-46d2-8c55-109b4efd2d7a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:28.294056 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a6b0c06-81a4-46d2-8c55-109b4efd2d7a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:28.295069 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bb3681ca-1c61-42a4-876d-44399866bedc req-1836acd6-b3ae-4797-ba12-ea895c3d8b08 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:28.295502 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bb3681ca-1c61-42a4-876d-44399866bedc req-1836acd6-b3ae-4797-ba12-ea895c3d8b08 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:28.309196 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-bb3681ca-1c61-42a4-876d-44399866bedc req-1836acd6-b3ae-4797-ba12-ea895c3d8b08 service nova] Creating event network-changed:d06f77e6-19cf-4197-85ed-4921523a9bd2 for instance e7b330ee-3ee9-48ec-bd24-81e216ae78ae on hv-cinder-81565 Oct 28 08:48:28.315034 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-bb3681ca-1c61-42a4-876d-44399866bedc req-1836acd6-b3ae-4797-ba12-ea895c3d8b08 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032036 Oct 28 08:48:28.315959 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 563/1122] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:48:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:48:28.358883 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5a6b0c06-81a4-46d2-8c55-109b4efd2d7a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 14 microversion: 2.1 time: 0.079525 Oct 28 08:48:28.362947 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 560/1123] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:28 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:48:28.532796 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a8455a41-7746-4065-baa6-e8406822c34e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:28.534058 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a8455a41-7746-4065-baa6-e8406822c34e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:28.540058 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8455a41-7746-4065-baa6-e8406822c34e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:28.540578 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8455a41-7746-4065-baa6-e8406822c34e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:28.541408 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8455a41-7746-4065-baa6-e8406822c34e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:28.541907 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8455a41-7746-4065-baa6-e8406822c34e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:28.604036 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a8455a41-7746-4065-baa6-e8406822c34e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.076259 Oct 28 08:48:28.605281 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 564/1124] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:28 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:48:29.245546 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e2e61fcb-0226-40b7-aa49-0834f428f0ac tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:29.246163 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e2e61fcb-0226-40b7-aa49-0834f428f0ac tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:29.253938 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2e61fcb-0226-40b7-aa49-0834f428f0ac tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:29.254394 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2e61fcb-0226-40b7-aa49-0834f428f0ac tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:29.255189 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2e61fcb-0226-40b7-aa49-0834f428f0ac tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:29.255625 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2e61fcb-0226-40b7-aa49-0834f428f0ac tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:29.371023 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9a189e1b-f27e-4904-9746-fbc17622305c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:29.372127 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9a189e1b-f27e-4904-9746-fbc17622305c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:29.383304 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-e2e61fcb-0226-40b7-aa49-0834f428f0ac tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:29.383958 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a189e1b-f27e-4904-9746-fbc17622305c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:29.384752 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a189e1b-f27e-4904-9746-fbc17622305c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:29.385550 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a189e1b-f27e-4904-9746-fbc17622305c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:29.385984 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a189e1b-f27e-4904-9746-fbc17622305c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:29.394545 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e2e61fcb-0226-40b7-aa49-0834f428f0ac tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1569 microversion: 2.1 time: 0.153005 Oct 28 08:48:29.395447 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 561/1125] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:29 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:29.469290 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9a189e1b-f27e-4904-9746-fbc17622305c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 14 microversion: 2.1 time: 0.101723 Oct 28 08:48:29.469919 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 565/1126] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:29 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:48:29.616937 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1ae1292b-cde1-4fbd-bdc6-18177ccdd9a0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:29.617842 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1ae1292b-cde1-4fbd-bdc6-18177ccdd9a0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:29.624071 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ae1292b-cde1-4fbd-bdc6-18177ccdd9a0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:29.624535 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ae1292b-cde1-4fbd-bdc6-18177ccdd9a0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:29.626530 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ae1292b-cde1-4fbd-bdc6-18177ccdd9a0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:29.626967 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ae1292b-cde1-4fbd-bdc6-18177ccdd9a0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:29.691641 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1ae1292b-cde1-4fbd-bdc6-18177ccdd9a0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.078307 Oct 28 08:48:29.692313 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 562/1127] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:29 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:30.413337 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3321c869-1f05-4456-82ce-244277dbe000 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:30.414021 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3321c869-1f05-4456-82ce-244277dbe000 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:30.420852 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3321c869-1f05-4456-82ce-244277dbe000 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:30.421292 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3321c869-1f05-4456-82ce-244277dbe000 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:30.422839 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3321c869-1f05-4456-82ce-244277dbe000 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:30.423269 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3321c869-1f05-4456-82ce-244277dbe000 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:30.480598 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3bbadcd5-4fb9-4e7e-9f98-970b06ca4be5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:30.481585 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3bbadcd5-4fb9-4e7e-9f98-970b06ca4be5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:30.488873 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bbadcd5-4fb9-4e7e-9f98-970b06ca4be5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:30.489307 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bbadcd5-4fb9-4e7e-9f98-970b06ca4be5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:30.490082 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bbadcd5-4fb9-4e7e-9f98-970b06ca4be5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:30.490525 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bbadcd5-4fb9-4e7e-9f98-970b06ca4be5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:30.550289 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3bbadcd5-4fb9-4e7e-9f98-970b06ca4be5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 14 microversion: 2.1 time: 0.073427 Oct 28 08:48:30.551085 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 563/1128] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:30 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 08:48:30.554179 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3321c869-1f05-4456-82ce-244277dbe000 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:30.561883 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3321c869-1f05-4456-82ce-244277dbe000 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1569 microversion: 2.1 time: 0.152559 Oct 28 08:48:30.562508 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 566/1129] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:30 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:30.703812 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-365ed8f4-026a-479a-b474-d449d94cdda7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:30.705172 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-365ed8f4-026a-479a-b474-d449d94cdda7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:30.712330 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-365ed8f4-026a-479a-b474-d449d94cdda7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:30.712963 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-365ed8f4-026a-479a-b474-d449d94cdda7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:30.713726 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-365ed8f4-026a-479a-b474-d449d94cdda7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:30.714149 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-365ed8f4-026a-479a-b474-d449d94cdda7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:30.786350 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-365ed8f4-026a-479a-b474-d449d94cdda7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.087023 Oct 28 08:48:30.786926 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 564/1130] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:30 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:31.561572 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-63da033d-dfc2-4602-a488-ead12dae629b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:31.563171 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-63da033d-dfc2-4602-a488-ead12dae629b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:31.569385 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63da033d-dfc2-4602-a488-ead12dae629b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:31.569831 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63da033d-dfc2-4602-a488-ead12dae629b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:31.570629 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63da033d-dfc2-4602-a488-ead12dae629b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:31.571064 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63da033d-dfc2-4602-a488-ead12dae629b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:31.579182 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0e3534b1-e260-4001-939a-8dd6fc030be7 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:31.579880 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0e3534b1-e260-4001-939a-8dd6fc030be7 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:31.586616 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e3534b1-e260-4001-939a-8dd6fc030be7 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:31.587066 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e3534b1-e260-4001-939a-8dd6fc030be7 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:31.587841 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e3534b1-e260-4001-939a-8dd6fc030be7 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:31.588273 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e3534b1-e260-4001-939a-8dd6fc030be7 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:31.630507 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-63da033d-dfc2-4602-a488-ead12dae629b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 14 microversion: 2.1 time: 0.072346 Oct 28 08:48:31.633853 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 567/1131] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:31 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:48:31.712028 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-0e3534b1-e260-4001-939a-8dd6fc030be7 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:31.723705 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0e3534b1-e260-4001-939a-8dd6fc030be7 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1569 microversion: 2.1 time: 0.148121 Oct 28 08:48:31.724297 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 565/1132] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:31 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:48:31.798344 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-88e0e9db-0655-4138-b987-69f9ced67246 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:31.799453 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-88e0e9db-0655-4138-b987-69f9ced67246 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:31.806209 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88e0e9db-0655-4138-b987-69f9ced67246 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:31.806697 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88e0e9db-0655-4138-b987-69f9ced67246 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:31.807472 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88e0e9db-0655-4138-b987-69f9ced67246 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:31.807909 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88e0e9db-0655-4138-b987-69f9ced67246 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:31.871663 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-88e0e9db-0655-4138-b987-69f9ced67246 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.077701 Oct 28 08:48:31.872461 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 568/1133] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:31 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:32.641631 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-11a72f4f-e078-4392-9d2d-ddc6d869a315 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:32.642591 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-11a72f4f-e078-4392-9d2d-ddc6d869a315 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:32.650103 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11a72f4f-e078-4392-9d2d-ddc6d869a315 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:32.650571 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11a72f4f-e078-4392-9d2d-ddc6d869a315 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:32.651342 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11a72f4f-e078-4392-9d2d-ddc6d869a315 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:32.651767 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11a72f4f-e078-4392-9d2d-ddc6d869a315 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:32.710377 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-11a72f4f-e078-4392-9d2d-ddc6d869a315 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 14 microversion: 2.1 time: 0.072336 Oct 28 08:48:32.712524 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 566/1134] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:32 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 08:48:32.741914 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-50244339-536c-475e-84ef-59503e525aed tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:32.742645 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-50244339-536c-475e-84ef-59503e525aed tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:32.749331 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50244339-536c-475e-84ef-59503e525aed tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:32.751362 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50244339-536c-475e-84ef-59503e525aed tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:32.752142 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50244339-536c-475e-84ef-59503e525aed tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:32.752570 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50244339-536c-475e-84ef-59503e525aed tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:32.878779 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-50244339-536c-475e-84ef-59503e525aed tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:32.884194 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a024a3fe-ee27-49db-9931-39358ddeda05 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:32.885179 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a024a3fe-ee27-49db-9931-39358ddeda05 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:32.886875 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-50244339-536c-475e-84ef-59503e525aed tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1569 microversion: 2.1 time: 0.148944 Oct 28 08:48:32.887520 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 569/1135] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:32 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:32.893044 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a024a3fe-ee27-49db-9931-39358ddeda05 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:32.893490 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a024a3fe-ee27-49db-9931-39358ddeda05 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:32.894307 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a024a3fe-ee27-49db-9931-39358ddeda05 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:32.894766 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a024a3fe-ee27-49db-9931-39358ddeda05 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:32.955820 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a024a3fe-ee27-49db-9931-39358ddeda05 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.075480 Oct 28 08:48:32.956465 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 567/1136] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:32 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:33.721858 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-05b322a2-4f89-4e48-b3e7-56849ae2d1cb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:33.722808 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-05b322a2-4f89-4e48-b3e7-56849ae2d1cb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:33.729100 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05b322a2-4f89-4e48-b3e7-56849ae2d1cb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:33.729548 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05b322a2-4f89-4e48-b3e7-56849ae2d1cb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:33.730312 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05b322a2-4f89-4e48-b3e7-56849ae2d1cb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:33.730773 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05b322a2-4f89-4e48-b3e7-56849ae2d1cb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:33.789035 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-05b322a2-4f89-4e48-b3e7-56849ae2d1cb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 14 microversion: 2.1 time: 0.071328 Oct 28 08:48:33.789750 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 570/1137] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:33 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 08:48:33.905279 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3cc0526e-4e35-4596-850f-a444bb9c57e8 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:33.906585 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3cc0526e-4e35-4596-850f-a444bb9c57e8 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:33.913703 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cc0526e-4e35-4596-850f-a444bb9c57e8 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:33.914149 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cc0526e-4e35-4596-850f-a444bb9c57e8 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:33.914943 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cc0526e-4e35-4596-850f-a444bb9c57e8 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:33.915375 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cc0526e-4e35-4596-850f-a444bb9c57e8 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:33.967962 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-12827d3a-b823-4173-a59d-6af743d070c9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:33.969837 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-12827d3a-b823-4173-a59d-6af743d070c9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:33.976984 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12827d3a-b823-4173-a59d-6af743d070c9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:33.977405 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12827d3a-b823-4173-a59d-6af743d070c9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:33.979101 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12827d3a-b823-4173-a59d-6af743d070c9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:33.979535 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12827d3a-b823-4173-a59d-6af743d070c9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:34.044521 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-3cc0526e-4e35-4596-850f-a444bb9c57e8 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:34.052506 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3cc0526e-4e35-4596-850f-a444bb9c57e8 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1569 microversion: 2.1 time: 0.151236 Oct 28 08:48:34.053075 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 568/1138] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:33 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:34.055049 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-12827d3a-b823-4173-a59d-6af743d070c9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.091157 Oct 28 08:48:34.055869 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 571/1139] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:33 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:48:34.800678 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9795d444-8a3e-4da8-a57d-f863f5deca58 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:34.801587 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9795d444-8a3e-4da8-a57d-f863f5deca58 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:34.807924 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9795d444-8a3e-4da8-a57d-f863f5deca58 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:34.808362 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9795d444-8a3e-4da8-a57d-f863f5deca58 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:34.809113 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9795d444-8a3e-4da8-a57d-f863f5deca58 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:34.809538 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9795d444-8a3e-4da8-a57d-f863f5deca58 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:34.870815 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9795d444-8a3e-4da8-a57d-f863f5deca58 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 14 microversion: 2.1 time: 0.074266 Oct 28 08:48:34.871492 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 569/1140] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:34 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:48:35.068342 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3060b5db-3de2-48ac-b82a-4dd1ff6f03c4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:35.069264 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3060b5db-3de2-48ac-b82a-4dd1ff6f03c4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:35.076383 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3060b5db-3de2-48ac-b82a-4dd1ff6f03c4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:35.076837 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3060b5db-3de2-48ac-b82a-4dd1ff6f03c4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:35.077660 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3060b5db-3de2-48ac-b82a-4dd1ff6f03c4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:35.078107 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3060b5db-3de2-48ac-b82a-4dd1ff6f03c4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:35.082148 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-92a52768-9bc9-4f7b-bd19-f88eec95e6cb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:35.082880 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-92a52768-9bc9-4f7b-bd19-f88eec95e6cb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:35.089927 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92a52768-9bc9-4f7b-bd19-f88eec95e6cb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:35.090371 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92a52768-9bc9-4f7b-bd19-f88eec95e6cb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:35.091167 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92a52768-9bc9-4f7b-bd19-f88eec95e6cb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:35.091593 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92a52768-9bc9-4f7b-bd19-f88eec95e6cb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:35.144960 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3060b5db-3de2-48ac-b82a-4dd1ff6f03c4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.080828 Oct 28 08:48:35.148833 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 572/1141] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:35 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:35.269219 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-92a52768-9bc9-4f7b-bd19-f88eec95e6cb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:35.276677 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-92a52768-9bc9-4f7b-bd19-f88eec95e6cb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1569 microversion: 2.1 time: 0.203245 Oct 28 08:48:35.277246 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 570/1142] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:35 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:35.882391 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-469bc384-9917-4772-9117-b0e6358c006a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:35.883423 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-469bc384-9917-4772-9117-b0e6358c006a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:35.890273 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-469bc384-9917-4772-9117-b0e6358c006a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:35.891327 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-469bc384-9917-4772-9117-b0e6358c006a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:35.892103 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-469bc384-9917-4772-9117-b0e6358c006a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:35.892537 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-469bc384-9917-4772-9117-b0e6358c006a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:35.949863 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-469bc384-9917-4772-9117-b0e6358c006a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 14 microversion: 2.1 time: 0.071493 Oct 28 08:48:35.950519 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 573/1143] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:35 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:48:36.156658 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1fd8c49a-e199-4dcb-8fd4-80cc202ef3ba tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:36.157493 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1fd8c49a-e199-4dcb-8fd4-80cc202ef3ba tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:36.163651 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fd8c49a-e199-4dcb-8fd4-80cc202ef3ba tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:36.164092 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fd8c49a-e199-4dcb-8fd4-80cc202ef3ba tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:36.164866 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fd8c49a-e199-4dcb-8fd4-80cc202ef3ba tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:36.165272 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fd8c49a-e199-4dcb-8fd4-80cc202ef3ba tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:36.228415 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1fd8c49a-e199-4dcb-8fd4-80cc202ef3ba tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.075437 Oct 28 08:48:36.229057 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 571/1144] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:36 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:36.294974 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b194ce00-6f6e-4726-be08-5270682a290b tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:36.295673 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b194ce00-6f6e-4726-be08-5270682a290b tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:36.303098 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b194ce00-6f6e-4726-be08-5270682a290b tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:36.303536 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b194ce00-6f6e-4726-be08-5270682a290b tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:36.304288 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b194ce00-6f6e-4726-be08-5270682a290b tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:36.304826 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b194ce00-6f6e-4726-be08-5270682a290b tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:36.429097 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-b194ce00-6f6e-4726-be08-5270682a290b tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:36.436807 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b194ce00-6f6e-4726-be08-5270682a290b tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1569 microversion: 2.1 time: 0.146057 Oct 28 08:48:36.437444 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 574/1145] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:36 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1569 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:36.961353 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ed6d1673-8196-4c02-a973-1ca1f370c8b1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:36.962381 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ed6d1673-8196-4c02-a973-1ca1f370c8b1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:36.970064 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed6d1673-8196-4c02-a973-1ca1f370c8b1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:36.970537 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed6d1673-8196-4c02-a973-1ca1f370c8b1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:36.971297 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed6d1673-8196-4c02-a973-1ca1f370c8b1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:36.971723 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed6d1673-8196-4c02-a973-1ca1f370c8b1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:37.035674 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ed6d1673-8196-4c02-a973-1ca1f370c8b1 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 14 microversion: 2.1 time: 0.078321 Oct 28 08:48:37.036300 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 572/1146] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:36 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:48:37.240204 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2dfc21e0-2472-4b4d-9b64-1e1e7185fb79 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:37.241087 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2dfc21e0-2472-4b4d-9b64-1e1e7185fb79 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:37.248596 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2dfc21e0-2472-4b4d-9b64-1e1e7185fb79 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:37.249041 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2dfc21e0-2472-4b4d-9b64-1e1e7185fb79 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:37.249810 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2dfc21e0-2472-4b4d-9b64-1e1e7185fb79 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:37.250996 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2dfc21e0-2472-4b4d-9b64-1e1e7185fb79 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:37.322969 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2dfc21e0-2472-4b4d-9b64-1e1e7185fb79 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.086545 Oct 28 08:48:37.324490 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 575/1147] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:37 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:37.454279 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5ff3a108-262b-43fa-bcb4-cdb18f28bbc9 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:37.455051 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5ff3a108-262b-43fa-bcb4-cdb18f28bbc9 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:37.461907 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ff3a108-262b-43fa-bcb4-cdb18f28bbc9 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:37.462356 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ff3a108-262b-43fa-bcb4-cdb18f28bbc9 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:37.463151 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ff3a108-262b-43fa-bcb4-cdb18f28bbc9 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:37.463588 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ff3a108-262b-43fa-bcb4-cdb18f28bbc9 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:37.597045 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-5ff3a108-262b-43fa-bcb4-cdb18f28bbc9 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:37.604359 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5ff3a108-262b-43fa-bcb4-cdb18f28bbc9 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1569 microversion: 2.1 time: 0.154994 Oct 28 08:48:37.604972 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 573/1148] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:37 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:38.049362 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a4290c95-192e-4586-828c-71dc477ed6e5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:38.050368 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a4290c95-192e-4586-828c-71dc477ed6e5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:38.057162 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4290c95-192e-4586-828c-71dc477ed6e5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:38.057604 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4290c95-192e-4586-828c-71dc477ed6e5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:38.058396 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4290c95-192e-4586-828c-71dc477ed6e5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:38.058902 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4290c95-192e-4586-828c-71dc477ed6e5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:38.129002 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a4290c95-192e-4586-828c-71dc477ed6e5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 14 microversion: 2.1 time: 0.085151 Oct 28 08:48:38.130420 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 576/1149] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:38 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:48:38.335815 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-777358c7-7dee-4c49-b298-87bf0613f272 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:38.336743 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-777358c7-7dee-4c49-b298-87bf0613f272 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:38.343379 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-777358c7-7dee-4c49-b298-87bf0613f272 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:38.343894 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-777358c7-7dee-4c49-b298-87bf0613f272 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:38.345223 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-777358c7-7dee-4c49-b298-87bf0613f272 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:38.345672 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-777358c7-7dee-4c49-b298-87bf0613f272 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:38.415347 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-777358c7-7dee-4c49-b298-87bf0613f272 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.083062 Oct 28 08:48:38.415993 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 574/1150] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:38 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:38.623438 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7f966d76-e9ae-4549-9382-76bf6633d817 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:38.623960 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7f966d76-e9ae-4549-9382-76bf6633d817 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:38.631768 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f966d76-e9ae-4549-9382-76bf6633d817 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:38.632204 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f966d76-e9ae-4549-9382-76bf6633d817 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:38.632959 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f966d76-e9ae-4549-9382-76bf6633d817 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:38.633382 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f966d76-e9ae-4549-9382-76bf6633d817 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:38.754896 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-7f966d76-e9ae-4549-9382-76bf6633d817 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:38.762342 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7f966d76-e9ae-4549-9382-76bf6633d817 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1510 microversion: 2.1 time: 0.143222 Oct 28 08:48:38.762950 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 577/1151] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:38 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1510 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:38.779712 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-42faf7b2-1f02-4b3d-9a90-6bd0c48e3216 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:38.780387 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-42faf7b2-1f02-4b3d-9a90-6bd0c48e3216 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:38.787223 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42faf7b2-1f02-4b3d-9a90-6bd0c48e3216 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:38.787668 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42faf7b2-1f02-4b3d-9a90-6bd0c48e3216 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:38.788433 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42faf7b2-1f02-4b3d-9a90-6bd0c48e3216 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:38.788865 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42faf7b2-1f02-4b3d-9a90-6bd0c48e3216 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:38.866900 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-42faf7b2-1f02-4b3d-9a90-6bd0c48e3216 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "POST /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1/action" status: 202 len: 0 microversion: 2.1 time: 0.091165 Oct 28 08:48:38.867513 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 575/1152] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:38 2021] POST /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:38.875992 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-961eed4e-7900-488e-8b8a-1f47fbc29249 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:38.876554 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-961eed4e-7900-488e-8b8a-1f47fbc29249 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:38.882842 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-961eed4e-7900-488e-8b8a-1f47fbc29249 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:38.883285 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-961eed4e-7900-488e-8b8a-1f47fbc29249 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:38.884087 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-961eed4e-7900-488e-8b8a-1f47fbc29249 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:38.884515 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-961eed4e-7900-488e-8b8a-1f47fbc29249 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:39.011060 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-961eed4e-7900-488e-8b8a-1f47fbc29249 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:39.018519 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-961eed4e-7900-488e-8b8a-1f47fbc29249 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1518 microversion: 2.1 time: 0.146827 Oct 28 08:48:39.019101 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 578/1153] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:38 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1518 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:39.140278 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b272febd-7e82-49c2-bc4a-d4754c9626b9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:39.141370 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b272febd-7e82-49c2-bc4a-d4754c9626b9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:39.147301 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b272febd-7e82-49c2-bc4a-d4754c9626b9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:39.147743 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b272febd-7e82-49c2-bc4a-d4754c9626b9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:39.148505 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b272febd-7e82-49c2-bc4a-d4754c9626b9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:39.148935 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b272febd-7e82-49c2-bc4a-d4754c9626b9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:39.228122 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b272febd-7e82-49c2-bc4a-d4754c9626b9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 11132 microversion: 2.1 time: 0.091867 Oct 28 08:48:39.228761 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 576/1154] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:39 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 11132 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:48:39.427859 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f9b228fb-49d6-4f99-bb57-e97144204254 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:39.428851 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f9b228fb-49d6-4f99-bb57-e97144204254 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:39.435608 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9b228fb-49d6-4f99-bb57-e97144204254 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:39.436053 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9b228fb-49d6-4f99-bb57-e97144204254 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:39.436823 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9b228fb-49d6-4f99-bb57-e97144204254 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:39.437252 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9b228fb-49d6-4f99-bb57-e97144204254 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:39.514165 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f9b228fb-49d6-4f99-bb57-e97144204254 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.090162 Oct 28 08:48:39.518185 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 579/1155] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:39 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:40.037731 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-49ef4227-5029-4d1f-b707-64eb405a1b32 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:40.038438 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-49ef4227-5029-4d1f-b707-64eb405a1b32 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:40.044908 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49ef4227-5029-4d1f-b707-64eb405a1b32 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:40.045359 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49ef4227-5029-4d1f-b707-64eb405a1b32 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:40.046138 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49ef4227-5029-4d1f-b707-64eb405a1b32 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:40.046594 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49ef4227-5029-4d1f-b707-64eb405a1b32 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:40.178470 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-49ef4227-5029-4d1f-b707-64eb405a1b32 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:40.186387 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-49ef4227-5029-4d1f-b707-64eb405a1b32 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1520 microversion: 2.1 time: 0.153672 Oct 28 08:48:40.186995 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 577/1156] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:40 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:40.241110 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-65e57314-048e-46f7-9d84-51e3b398b7da tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:40.242115 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-65e57314-048e-46f7-9d84-51e3b398b7da tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:40.248965 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65e57314-048e-46f7-9d84-51e3b398b7da tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:40.249407 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65e57314-048e-46f7-9d84-51e3b398b7da tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:40.250308 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65e57314-048e-46f7-9d84-51e3b398b7da tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:40.250870 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65e57314-048e-46f7-9d84-51e3b398b7da tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:40.333587 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-65e57314-048e-46f7-9d84-51e3b398b7da tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 17250 microversion: 2.1 time: 0.096742 Oct 28 08:48:40.334228 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 580/1157] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:40 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 17250 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:48:40.525440 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-11884929-d27f-4737-abdb-e56e27d791e9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:40.526511 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-11884929-d27f-4737-abdb-e56e27d791e9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:40.534273 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11884929-d27f-4737-abdb-e56e27d791e9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:40.534838 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11884929-d27f-4737-abdb-e56e27d791e9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:40.535621 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11884929-d27f-4737-abdb-e56e27d791e9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:40.536059 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11884929-d27f-4737-abdb-e56e27d791e9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:40.598341 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-11884929-d27f-4737-abdb-e56e27d791e9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.076496 Oct 28 08:48:40.602305 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 578/1158] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:40 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:41.205205 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3b2e3322-4d14-4dfd-9db9-0116b51c02fb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:41.205893 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3b2e3322-4d14-4dfd-9db9-0116b51c02fb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:41.212690 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3b2e3322-4d14-4dfd-9db9-0116b51c02fb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:41.213137 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3b2e3322-4d14-4dfd-9db9-0116b51c02fb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:41.213907 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3b2e3322-4d14-4dfd-9db9-0116b51c02fb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:41.214593 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3b2e3322-4d14-4dfd-9db9-0116b51c02fb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:41.345984 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3b2e3322-4d14-4dfd-9db9-0116b51c02fb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:41.346693 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b27e30b3-0a6e-45c7-9f68-1d05fe22bc58 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:41.347264 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b27e30b3-0a6e-45c7-9f68-1d05fe22bc58 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:41.353892 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b27e30b3-0a6e-45c7-9f68-1d05fe22bc58 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:41.354071 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3b2e3322-4d14-4dfd-9db9-0116b51c02fb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1576 microversion: 2.1 time: 0.153617 Oct 28 08:48:41.354339 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b27e30b3-0a6e-45c7-9f68-1d05fe22bc58 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:41.355312 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 581/1159] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:41 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:41.355468 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b27e30b3-0a6e-45c7-9f68-1d05fe22bc58 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:41.355572 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b27e30b3-0a6e-45c7-9f68-1d05fe22bc58 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:41.431641 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b27e30b3-0a6e-45c7-9f68-1d05fe22bc58 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 18356 microversion: 2.1 time: 0.090421 Oct 28 08:48:41.432272 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 579/1160] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:41 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 18356 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:48:41.611354 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6397d6d8-331f-419e-aa7c-5d4e905fad7a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:41.612192 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6397d6d8-331f-419e-aa7c-5d4e905fad7a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:41.618372 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6397d6d8-331f-419e-aa7c-5d4e905fad7a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:41.618845 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6397d6d8-331f-419e-aa7c-5d4e905fad7a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:41.619605 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6397d6d8-331f-419e-aa7c-5d4e905fad7a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:41.620030 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6397d6d8-331f-419e-aa7c-5d4e905fad7a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:41.776401 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6397d6d8-331f-419e-aa7c-5d4e905fad7a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.169969 Oct 28 08:48:41.777233 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 582/1161] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:41 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:42.220607 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-c2d19eb1-95cf-4b48-8dfd-17f6f835f8b6 req-2c866533-fb26-49b3-974b-e52639757aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de3329c3-6608-4f3d-a14e-a1c563567ca1", "name": "network-vif-unplugged", "status": "completed", "tag": "0740398f-07ce-4e13-b20f-5cf387cc8ba7"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:42.222181 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:48:42.222181 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:48:42.231057 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c2d19eb1-95cf-4b48-8dfd-17f6f835f8b6 req-2c866533-fb26-49b3-974b-e52639757aa3 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:42.231488 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c2d19eb1-95cf-4b48-8dfd-17f6f835f8b6 req-2c866533-fb26-49b3-974b-e52639757aa3 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:42.243721 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-c2d19eb1-95cf-4b48-8dfd-17f6f835f8b6 req-2c866533-fb26-49b3-974b-e52639757aa3 service nova] Creating event network-vif-unplugged:0740398f-07ce-4e13-b20f-5cf387cc8ba7 for instance de3329c3-6608-4f3d-a14e-a1c563567ca1 on hv-cinder-81565 Oct 28 08:48:42.248465 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-c2d19eb1-95cf-4b48-8dfd-17f6f835f8b6 req-2c866533-fb26-49b3-974b-e52639757aa3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032547 Oct 28 08:48:42.249228 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 580/1162] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:48:42 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:48:42.372888 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7fbc4f37-5168-4126-bbcc-4b16e33e0e7a tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:42.373608 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7fbc4f37-5168-4126-bbcc-4b16e33e0e7a tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:42.380525 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7fbc4f37-5168-4126-bbcc-4b16e33e0e7a tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:42.380980 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7fbc4f37-5168-4126-bbcc-4b16e33e0e7a tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:42.381739 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7fbc4f37-5168-4126-bbcc-4b16e33e0e7a tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:42.382171 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7fbc4f37-5168-4126-bbcc-4b16e33e0e7a tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:42.443781 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bb8af348-870a-47a1-979f-176b198c7c88 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:42.444788 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bb8af348-870a-47a1-979f-176b198c7c88 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:42.451608 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb8af348-870a-47a1-979f-176b198c7c88 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:42.452064 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb8af348-870a-47a1-979f-176b198c7c88 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:42.452853 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb8af348-870a-47a1-979f-176b198c7c88 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:42.453292 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb8af348-870a-47a1-979f-176b198c7c88 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:42.528164 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bb8af348-870a-47a1-979f-176b198c7c88 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 20997 microversion: 2.1 time: 0.088117 Oct 28 08:48:42.528710 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 581/1163] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:42 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 20997 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:48:42.732794 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-7fbc4f37-5168-4126-bbcc-4b16e33e0e7a tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:42.741231 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7fbc4f37-5168-4126-bbcc-4b16e33e0e7a tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1576 microversion: 2.1 time: 0.372370 Oct 28 08:48:42.741796 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 583/1164] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:42 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1576 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:42.788524 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-561087af-0f4e-44ba-aaf8-ca4fe913f34b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:42.789492 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-561087af-0f4e-44ba-aaf8-ca4fe913f34b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:42.796374 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-561087af-0f4e-44ba-aaf8-ca4fe913f34b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:42.796819 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-561087af-0f4e-44ba-aaf8-ca4fe913f34b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:42.797582 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-561087af-0f4e-44ba-aaf8-ca4fe913f34b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:42.798714 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-561087af-0f4e-44ba-aaf8-ca4fe913f34b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:42.863574 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-561087af-0f4e-44ba-aaf8-ca4fe913f34b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.078964 Oct 28 08:48:42.864216 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 582/1165] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:42 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:43.539833 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5d661c16-60e7-4050-adf2-7b616fc4a753 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:43.540674 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5d661c16-60e7-4050-adf2-7b616fc4a753 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:43.548200 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d661c16-60e7-4050-adf2-7b616fc4a753 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:43.548649 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d661c16-60e7-4050-adf2-7b616fc4a753 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:43.549527 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d661c16-60e7-4050-adf2-7b616fc4a753 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:43.549958 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d661c16-60e7-4050-adf2-7b616fc4a753 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:43.630292 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5d661c16-60e7-4050-adf2-7b616fc4a753 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 22979 microversion: 2.1 time: 0.094015 Oct 28 08:48:43.631062 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 584/1166] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:43 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 22979 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:48:43.758020 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-500a5c1d-f36c-4c04-b206-8662902fb410 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:43.758732 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-500a5c1d-f36c-4c04-b206-8662902fb410 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:43.765440 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-500a5c1d-f36c-4c04-b206-8662902fb410 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:43.765879 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-500a5c1d-f36c-4c04-b206-8662902fb410 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:43.767199 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-500a5c1d-f36c-4c04-b206-8662902fb410 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:43.767633 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-500a5c1d-f36c-4c04-b206-8662902fb410 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:43.874685 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-61830f34-0421-4e5c-8426-cc02248487f8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:43.875691 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-61830f34-0421-4e5c-8426-cc02248487f8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:43.882632 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61830f34-0421-4e5c-8426-cc02248487f8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:43.883073 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61830f34-0421-4e5c-8426-cc02248487f8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:43.883843 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61830f34-0421-4e5c-8426-cc02248487f8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:43.884270 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61830f34-0421-4e5c-8426-cc02248487f8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:43.892854 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-500a5c1d-f36c-4c04-b206-8662902fb410 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:43.900978 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-500a5c1d-f36c-4c04-b206-8662902fb410 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1576 microversion: 2.1 time: 0.146930 Oct 28 08:48:43.910628 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 583/1167] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:43 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1576 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:43.945472 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-61830f34-0421-4e5c-8426-cc02248487f8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.074634 Oct 28 08:48:43.946393 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 585/1168] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:43 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:48:44.642648 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6ea5ca12-6006-41f3-a227-0da8d81f801f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:44.643574 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6ea5ca12-6006-41f3-a227-0da8d81f801f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:44.649905 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ea5ca12-6006-41f3-a227-0da8d81f801f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:44.650351 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ea5ca12-6006-41f3-a227-0da8d81f801f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:44.651148 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ea5ca12-6006-41f3-a227-0da8d81f801f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:44.651582 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ea5ca12-6006-41f3-a227-0da8d81f801f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:44.722781 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6ea5ca12-6006-41f3-a227-0da8d81f801f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 23997 microversion: 2.1 time: 0.084369 Oct 28 08:48:44.723417 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 584/1169] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:44 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 23997 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:48:44.919335 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0f997494-34f2-42ee-9753-e92aeb376758 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:44.919955 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0f997494-34f2-42ee-9753-e92aeb376758 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:44.927744 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f997494-34f2-42ee-9753-e92aeb376758 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:44.928192 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f997494-34f2-42ee-9753-e92aeb376758 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:44.928969 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f997494-34f2-42ee-9753-e92aeb376758 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:44.929401 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f997494-34f2-42ee-9753-e92aeb376758 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:44.957988 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ae030107-47c0-4c94-93f4-83afbad6e382 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:44.959034 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ae030107-47c0-4c94-93f4-83afbad6e382 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:44.966260 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae030107-47c0-4c94-93f4-83afbad6e382 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:44.966728 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae030107-47c0-4c94-93f4-83afbad6e382 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:44.967491 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae030107-47c0-4c94-93f4-83afbad6e382 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:44.967913 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae030107-47c0-4c94-93f4-83afbad6e382 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:45.030446 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ae030107-47c0-4c94-93f4-83afbad6e382 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.076714 Oct 28 08:48:45.034525 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 585/1170] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:44 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:48:45.052299 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-0f997494-34f2-42ee-9753-e92aeb376758 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:45.059675 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0f997494-34f2-42ee-9753-e92aeb376758 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1576 microversion: 2.1 time: 0.144705 Oct 28 08:48:45.060233 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 586/1171] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:44 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1576 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:45.734962 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-377efb87-ddfa-4aec-8bc4-9bbd9b44e2fc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:45.736004 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-377efb87-ddfa-4aec-8bc4-9bbd9b44e2fc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:45.743008 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-377efb87-ddfa-4aec-8bc4-9bbd9b44e2fc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:45.743448 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-377efb87-ddfa-4aec-8bc4-9bbd9b44e2fc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:45.744206 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-377efb87-ddfa-4aec-8bc4-9bbd9b44e2fc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:45.744639 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-377efb87-ddfa-4aec-8bc4-9bbd9b44e2fc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:45.815348 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-377efb87-ddfa-4aec-8bc4-9bbd9b44e2fc tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 25757 microversion: 2.1 time: 0.084266 Oct 28 08:48:45.816239 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 586/1172] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:45 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 25757 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:48:46.041175 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-46bdf763-0e9c-4d0a-9dce-07407e4aa687 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:46.042096 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-46bdf763-0e9c-4d0a-9dce-07407e4aa687 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:46.048555 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46bdf763-0e9c-4d0a-9dce-07407e4aa687 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:46.049007 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46bdf763-0e9c-4d0a-9dce-07407e4aa687 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:46.049776 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46bdf763-0e9c-4d0a-9dce-07407e4aa687 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:46.050246 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46bdf763-0e9c-4d0a-9dce-07407e4aa687 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:46.078275 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d66953fe-053b-419f-8016-74aea2e8e12e tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:46.080251 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d66953fe-053b-419f-8016-74aea2e8e12e tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:46.087229 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d66953fe-053b-419f-8016-74aea2e8e12e tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:46.087672 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d66953fe-053b-419f-8016-74aea2e8e12e tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:46.088480 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d66953fe-053b-419f-8016-74aea2e8e12e tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:46.088910 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d66953fe-053b-419f-8016-74aea2e8e12e tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:46.114023 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-46bdf763-0e9c-4d0a-9dce-07407e4aa687 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.076329 Oct 28 08:48:46.117936 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 587/1173] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:46 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:46.215065 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-d66953fe-053b-419f-8016-74aea2e8e12e tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:46.222832 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d66953fe-053b-419f-8016-74aea2e8e12e tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1576 microversion: 2.1 time: 0.149422 Oct 28 08:48:46.223390 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 587/1174] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:46 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:48:46.827561 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-256ab343-0457-4503-baae-b105a4fe522a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:46.828607 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-256ab343-0457-4503-baae-b105a4fe522a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:46.835777 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-256ab343-0457-4503-baae-b105a4fe522a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:46.836243 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-256ab343-0457-4503-baae-b105a4fe522a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:46.837016 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-256ab343-0457-4503-baae-b105a4fe522a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:46.837444 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-256ab343-0457-4503-baae-b105a4fe522a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:46.921788 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-256ab343-0457-4503-baae-b105a4fe522a tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 27048 microversion: 2.1 time: 0.097983 Oct 28 08:48:46.923407 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 588/1175] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:46 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 27048 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:48:47.125228 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4dc6b258-d4db-4b1f-9ea7-a7de02349cf7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:47.126335 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4dc6b258-d4db-4b1f-9ea7-a7de02349cf7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:47.132733 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4dc6b258-d4db-4b1f-9ea7-a7de02349cf7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:47.133176 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4dc6b258-d4db-4b1f-9ea7-a7de02349cf7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:47.133942 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4dc6b258-d4db-4b1f-9ea7-a7de02349cf7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:47.134383 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4dc6b258-d4db-4b1f-9ea7-a7de02349cf7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:47.202366 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4dc6b258-d4db-4b1f-9ea7-a7de02349cf7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.080685 Oct 28 08:48:47.203053 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 588/1176] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:47 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:47.240310 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b949bf4d-4a2b-4f75-8274-9e05855c4bec tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:47.240998 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b949bf4d-4a2b-4f75-8274-9e05855c4bec tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:47.247761 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b949bf4d-4a2b-4f75-8274-9e05855c4bec tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:47.248203 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b949bf4d-4a2b-4f75-8274-9e05855c4bec tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:47.248962 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b949bf4d-4a2b-4f75-8274-9e05855c4bec tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:47.249389 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b949bf4d-4a2b-4f75-8274-9e05855c4bec tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:47.375406 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-b949bf4d-4a2b-4f75-8274-9e05855c4bec tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:47.382992 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b949bf4d-4a2b-4f75-8274-9e05855c4bec tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1576 microversion: 2.1 time: 0.146632 Oct 28 08:48:47.383549 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 589/1177] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:47 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1576 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:47.934518 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-80b769ff-8768-4d58-b3d9-4f20725f1750 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:47.935531 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-80b769ff-8768-4d58-b3d9-4f20725f1750 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:47.943384 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80b769ff-8768-4d58-b3d9-4f20725f1750 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:47.943832 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80b769ff-8768-4d58-b3d9-4f20725f1750 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:47.944604 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80b769ff-8768-4d58-b3d9-4f20725f1750 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:47.945075 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80b769ff-8768-4d58-b3d9-4f20725f1750 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:48.022253 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-80b769ff-8768-4d58-b3d9-4f20725f1750 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 27671 microversion: 2.1 time: 0.091601 Oct 28 08:48:48.022938 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 589/1178] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:47 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 27671 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:48:48.215034 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4e3fe8c7-db03-4028-a5bb-26972c8d44fa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:48.215901 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4e3fe8c7-db03-4028-a5bb-26972c8d44fa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:48.222113 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e3fe8c7-db03-4028-a5bb-26972c8d44fa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:48.222578 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e3fe8c7-db03-4028-a5bb-26972c8d44fa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:48.223344 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e3fe8c7-db03-4028-a5bb-26972c8d44fa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:48.223776 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e3fe8c7-db03-4028-a5bb-26972c8d44fa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:48.311194 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4e3fe8c7-db03-4028-a5bb-26972c8d44fa tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.099932 Oct 28 08:48:48.311905 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 590/1179] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:48 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:48.401345 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6126f9aa-60fc-4dea-8fea-4891d506ec5c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:48.402178 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6126f9aa-60fc-4dea-8fea-4891d506ec5c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:48.410068 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6126f9aa-60fc-4dea-8fea-4891d506ec5c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:48.410680 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6126f9aa-60fc-4dea-8fea-4891d506ec5c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:48.411455 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6126f9aa-60fc-4dea-8fea-4891d506ec5c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:48.411885 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6126f9aa-60fc-4dea-8fea-4891d506ec5c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:48.539830 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-6126f9aa-60fc-4dea-8fea-4891d506ec5c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:48.548502 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6126f9aa-60fc-4dea-8fea-4891d506ec5c tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1576 microversion: 2.1 time: 0.150455 Oct 28 08:48:48.549074 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 590/1180] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:48 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:49.035374 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-07d7987c-a9cf-4529-8206-856ec9072050 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:49.036375 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-07d7987c-a9cf-4529-8206-856ec9072050 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:49.043199 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07d7987c-a9cf-4529-8206-856ec9072050 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:49.043643 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07d7987c-a9cf-4529-8206-856ec9072050 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:49.044412 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07d7987c-a9cf-4529-8206-856ec9072050 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:49.044846 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07d7987c-a9cf-4529-8206-856ec9072050 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:49.165591 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-07d7987c-a9cf-4529-8206-856ec9072050 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28031 microversion: 2.1 time: 0.134903 Oct 28 08:48:49.166522 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 591/1181] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:49 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28031 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:48:49.324331 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4b7147de-0267-43c0-b6f5-de19e5265217 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:49.325299 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4b7147de-0267-43c0-b6f5-de19e5265217 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:49.332843 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b7147de-0267-43c0-b6f5-de19e5265217 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:49.333280 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b7147de-0267-43c0-b6f5-de19e5265217 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:49.334107 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b7147de-0267-43c0-b6f5-de19e5265217 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:49.334711 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b7147de-0267-43c0-b6f5-de19e5265217 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:49.433769 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4b7147de-0267-43c0-b6f5-de19e5265217 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.113046 Oct 28 08:48:49.434427 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 591/1182] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:49 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:49.566334 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1ce8f437-058e-418b-a596-0c4ba30bc13f tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:49.567070 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1ce8f437-058e-418b-a596-0c4ba30bc13f tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:49.573962 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ce8f437-058e-418b-a596-0c4ba30bc13f tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:49.574455 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ce8f437-058e-418b-a596-0c4ba30bc13f tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:49.575206 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ce8f437-058e-418b-a596-0c4ba30bc13f tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:49.575647 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ce8f437-058e-418b-a596-0c4ba30bc13f tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:49.703626 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1ce8f437-058e-418b-a596-0c4ba30bc13f tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:49.711507 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1ce8f437-058e-418b-a596-0c4ba30bc13f tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1576 microversion: 2.1 time: 0.149950 Oct 28 08:48:49.712080 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 592/1183] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:49 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:50.178366 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-08795569-3669-4597-9c05-43e718fb4ae2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:50.179456 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-08795569-3669-4597-9c05-43e718fb4ae2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:50.186574 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08795569-3669-4597-9c05-43e718fb4ae2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:50.187021 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08795569-3669-4597-9c05-43e718fb4ae2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:50.187800 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08795569-3669-4597-9c05-43e718fb4ae2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:50.188232 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08795569-3669-4597-9c05-43e718fb4ae2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:50.270239 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-08795569-3669-4597-9c05-43e718fb4ae2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28215 microversion: 2.1 time: 0.095734 Oct 28 08:48:50.270968 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 592/1184] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:50 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28215 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:48:50.445256 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d7357c24-9ff1-4d96-a35b-0cce9f7cd6e0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:50.446176 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d7357c24-9ff1-4d96-a35b-0cce9f7cd6e0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:50.452428 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d7357c24-9ff1-4d96-a35b-0cce9f7cd6e0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:50.452874 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d7357c24-9ff1-4d96-a35b-0cce9f7cd6e0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:50.454150 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d7357c24-9ff1-4d96-a35b-0cce9f7cd6e0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:50.454616 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d7357c24-9ff1-4d96-a35b-0cce9f7cd6e0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:50.570290 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d7357c24-9ff1-4d96-a35b-0cce9f7cd6e0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.128536 Oct 28 08:48:50.570985 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 593/1185] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:50 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:50.729229 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e1d20bfa-abf7-4599-958e-391fbee2fa77 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:48:50.729914 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e1d20bfa-abf7-4599-958e-391fbee2fa77 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:50.737206 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1d20bfa-abf7-4599-958e-391fbee2fa77 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:50.737648 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1d20bfa-abf7-4599-958e-391fbee2fa77 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:50.738413 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1d20bfa-abf7-4599-958e-391fbee2fa77 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:50.738886 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1d20bfa-abf7-4599-958e-391fbee2fa77 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:50.865847 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-e1d20bfa-abf7-4599-958e-391fbee2fa77 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:48:50.873885 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e1d20bfa-abf7-4599-958e-391fbee2fa77 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1563 microversion: 2.1 time: 0.148607 Oct 28 08:48:50.874458 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 593/1186] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:48:50 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1563 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:48:51.282410 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-004b04d1-9f2e-4851-bf95-07eb69ebc3b4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:51.283512 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-004b04d1-9f2e-4851-bf95-07eb69ebc3b4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:51.290479 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-004b04d1-9f2e-4851-bf95-07eb69ebc3b4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:51.290948 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-004b04d1-9f2e-4851-bf95-07eb69ebc3b4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:51.291719 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-004b04d1-9f2e-4851-bf95-07eb69ebc3b4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:51.292174 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-004b04d1-9f2e-4851-bf95-07eb69ebc3b4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:51.361260 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-004b04d1-9f2e-4851-bf95-07eb69ebc3b4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28215 microversion: 2.1 time: 0.082483 Oct 28 08:48:51.362113 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 594/1187] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:51 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:48:51.581838 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-20558ade-3709-40bf-87a3-69c55c7121ca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:51.582803 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-20558ade-3709-40bf-87a3-69c55c7121ca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:51.589268 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20558ade-3709-40bf-87a3-69c55c7121ca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:51.589713 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20558ade-3709-40bf-87a3-69c55c7121ca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:51.590475 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20558ade-3709-40bf-87a3-69c55c7121ca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:51.590939 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20558ade-3709-40bf-87a3-69c55c7121ca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:51.688388 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-20558ade-3709-40bf-87a3-69c55c7121ca tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.109772 Oct 28 08:48:51.688972 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 594/1188] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:51 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:52.307940 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-80a29480-cd44-4ea8-b794-f3b5301eddd4 req-48dcfea3-b6c9-4ca3-930e-25005c2fa889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de3329c3-6608-4f3d-a14e-a1c563567ca1", "name": "network-vif-plugged", "status": "completed", "tag": "0740398f-07ce-4e13-b20f-5cf387cc8ba7"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:52.309460 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:48:52.309460 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:48:52.319512 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-80a29480-cd44-4ea8-b794-f3b5301eddd4 req-48dcfea3-b6c9-4ca3-930e-25005c2fa889 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:52.319960 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-80a29480-cd44-4ea8-b794-f3b5301eddd4 req-48dcfea3-b6c9-4ca3-930e-25005c2fa889 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:52.333228 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-80a29480-cd44-4ea8-b794-f3b5301eddd4 req-48dcfea3-b6c9-4ca3-930e-25005c2fa889 service nova] Creating event network-vif-plugged:0740398f-07ce-4e13-b20f-5cf387cc8ba7 for instance de3329c3-6608-4f3d-a14e-a1c563567ca1 on hv-cinder-81565 Oct 28 08:48:52.339096 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-80a29480-cd44-4ea8-b794-f3b5301eddd4 req-48dcfea3-b6c9-4ca3-930e-25005c2fa889 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034850 Oct 28 08:48:52.340046 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 595/1189] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:48:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:48:52.372473 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b43024b2-4c90-4e1b-b322-02c445665246 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:52.373601 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b43024b2-4c90-4e1b-b322-02c445665246 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:52.381269 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b43024b2-4c90-4e1b-b322-02c445665246 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:52.381717 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b43024b2-4c90-4e1b-b322-02c445665246 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:52.382477 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b43024b2-4c90-4e1b-b322-02c445665246 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:52.382936 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b43024b2-4c90-4e1b-b322-02c445665246 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:52.454034 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b43024b2-4c90-4e1b-b322-02c445665246 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28215 microversion: 2.1 time: 0.085309 Oct 28 08:48:52.454963 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 595/1190] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:52 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:48:52.700549 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-58e1bc6b-b228-430d-9486-cbaef0ea800e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:52.701538 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-58e1bc6b-b228-430d-9486-cbaef0ea800e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:52.708716 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58e1bc6b-b228-430d-9486-cbaef0ea800e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:52.709160 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58e1bc6b-b228-430d-9486-cbaef0ea800e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:52.709993 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58e1bc6b-b228-430d-9486-cbaef0ea800e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:52.710425 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58e1bc6b-b228-430d-9486-cbaef0ea800e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:52.777127 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-58e1bc6b-b228-430d-9486-cbaef0ea800e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.080472 Oct 28 08:48:52.778006 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 596/1191] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:52 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:53.466595 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-03ac4cc8-aa16-46d4-a21c-151e0dbf0a49 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:53.467520 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-03ac4cc8-aa16-46d4-a21c-151e0dbf0a49 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:53.475115 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03ac4cc8-aa16-46d4-a21c-151e0dbf0a49 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:53.475557 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03ac4cc8-aa16-46d4-a21c-151e0dbf0a49 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:53.476325 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03ac4cc8-aa16-46d4-a21c-151e0dbf0a49 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:53.476775 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03ac4cc8-aa16-46d4-a21c-151e0dbf0a49 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:53.543354 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-03ac4cc8-aa16-46d4-a21c-151e0dbf0a49 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28215 microversion: 2.1 time: 0.081283 Oct 28 08:48:53.544223 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 596/1192] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:53 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:48:53.789469 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1c3393a9-a97e-4ec4-8756-5c5d49e7d535 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:53.790372 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1c3393a9-a97e-4ec4-8756-5c5d49e7d535 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:53.797331 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c3393a9-a97e-4ec4-8756-5c5d49e7d535 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:53.798420 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c3393a9-a97e-4ec4-8756-5c5d49e7d535 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:53.799255 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c3393a9-a97e-4ec4-8756-5c5d49e7d535 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:53.799698 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c3393a9-a97e-4ec4-8756-5c5d49e7d535 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:53.863765 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1c3393a9-a97e-4ec4-8756-5c5d49e7d535 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.078261 Oct 28 08:48:53.864759 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 597/1193] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:53 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:54.554765 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-db5ba20e-63a3-4cb3-af36-1bfc4ec7c295 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:54.555771 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-db5ba20e-63a3-4cb3-af36-1bfc4ec7c295 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:54.562594 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db5ba20e-63a3-4cb3-af36-1bfc4ec7c295 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:54.563529 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db5ba20e-63a3-4cb3-af36-1bfc4ec7c295 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:54.564284 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db5ba20e-63a3-4cb3-af36-1bfc4ec7c295 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:54.564711 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db5ba20e-63a3-4cb3-af36-1bfc4ec7c295 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:54.664936 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-db5ba20e-63a3-4cb3-af36-1bfc4ec7c295 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28215 microversion: 2.1 time: 0.114083 Oct 28 08:48:54.665574 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 597/1194] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:54 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28215 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:48:54.876855 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7c0eb0f4-b8ed-4b9b-bd46-dd25fd39fe10 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:54.877821 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7c0eb0f4-b8ed-4b9b-bd46-dd25fd39fe10 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:54.884640 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c0eb0f4-b8ed-4b9b-bd46-dd25fd39fe10 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:54.885087 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c0eb0f4-b8ed-4b9b-bd46-dd25fd39fe10 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:54.885858 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c0eb0f4-b8ed-4b9b-bd46-dd25fd39fe10 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:54.886304 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c0eb0f4-b8ed-4b9b-bd46-dd25fd39fe10 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:54.946895 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7c0eb0f4-b8ed-4b9b-bd46-dd25fd39fe10 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 28662 microversion: 2.20 time: 0.074672 Oct 28 08:48:54.947550 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 598/1195] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:54 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 28662 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:55.678883 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-360e34b2-2a6e-4b2d-98a7-9828cd0f4e30 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:55.679880 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-360e34b2-2a6e-4b2d-98a7-9828cd0f4e30 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:55.686754 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-360e34b2-2a6e-4b2d-98a7-9828cd0f4e30 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:55.687208 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-360e34b2-2a6e-4b2d-98a7-9828cd0f4e30 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:55.687974 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-360e34b2-2a6e-4b2d-98a7-9828cd0f4e30 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:55.688440 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-360e34b2-2a6e-4b2d-98a7-9828cd0f4e30 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:55.756341 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-360e34b2-2a6e-4b2d-98a7-9828cd0f4e30 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28215 microversion: 2.1 time: 0.081398 Oct 28 08:48:55.757246 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 598/1196] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:55 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:48:55.959840 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2ffffbd3-bbe9-40f6-a092-13b53b0f8abe tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:55.960751 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2ffffbd3-bbe9-40f6-a092-13b53b0f8abe tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:55.967842 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ffffbd3-bbe9-40f6-a092-13b53b0f8abe tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:55.968285 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ffffbd3-bbe9-40f6-a092-13b53b0f8abe tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:55.969070 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ffffbd3-bbe9-40f6-a092-13b53b0f8abe tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:55.969534 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ffffbd3-bbe9-40f6-a092-13b53b0f8abe tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:56.049567 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2ffffbd3-bbe9-40f6-a092-13b53b0f8abe tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 29575 microversion: 2.20 time: 0.093767 Oct 28 08:48:56.050237 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 599/1197] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:55 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 29575 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:56.771486 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2d3610ff-bb74-48a2-b084-a0c33271fcf6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:56.772508 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2d3610ff-bb74-48a2-b084-a0c33271fcf6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:56.779311 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d3610ff-bb74-48a2-b084-a0c33271fcf6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:56.779746 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d3610ff-bb74-48a2-b084-a0c33271fcf6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:56.780503 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d3610ff-bb74-48a2-b084-a0c33271fcf6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:56.780925 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d3610ff-bb74-48a2-b084-a0c33271fcf6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:56.849378 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2d3610ff-bb74-48a2-b084-a0c33271fcf6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28215 microversion: 2.1 time: 0.081737 Oct 28 08:48:56.850045 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 599/1198] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:56 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:48:57.062012 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-290cc306-b962-4c8c-98ad-47a11c433f8b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:57.063319 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-290cc306-b962-4c8c-98ad-47a11c433f8b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:57.069866 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-290cc306-b962-4c8c-98ad-47a11c433f8b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:57.070302 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-290cc306-b962-4c8c-98ad-47a11c433f8b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:57.071110 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-290cc306-b962-4c8c-98ad-47a11c433f8b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:57.071541 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-290cc306-b962-4c8c-98ad-47a11c433f8b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:57.159263 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-290cc306-b962-4c8c-98ad-47a11c433f8b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 31358 microversion: 2.20 time: 0.101145 Oct 28 08:48:57.160118 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 600/1199] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:57 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 31358 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:57.862157 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-73a990fc-3d0e-4d36-acba-f4d5721f261e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:57.867348 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-73a990fc-3d0e-4d36-acba-f4d5721f261e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:57.870304 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73a990fc-3d0e-4d36-acba-f4d5721f261e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:57.870784 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73a990fc-3d0e-4d36-acba-f4d5721f261e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:57.871552 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73a990fc-3d0e-4d36-acba-f4d5721f261e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:57.871990 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73a990fc-3d0e-4d36-acba-f4d5721f261e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:57.949134 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-73a990fc-3d0e-4d36-acba-f4d5721f261e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28215 microversion: 2.1 time: 0.091526 Oct 28 08:48:57.950126 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 600/1200] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:57 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:48:58.171732 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f397be62-36ca-408c-ba28-7d3d803debf8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:58.173812 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f397be62-36ca-408c-ba28-7d3d803debf8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:58.180542 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f397be62-36ca-408c-ba28-7d3d803debf8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:58.181012 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f397be62-36ca-408c-ba28-7d3d803debf8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:58.181767 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f397be62-36ca-408c-ba28-7d3d803debf8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:58.182188 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f397be62-36ca-408c-ba28-7d3d803debf8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:58.260764 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f397be62-36ca-408c-ba28-7d3d803debf8 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 33020 microversion: 2.20 time: 0.092964 Oct 28 08:48:58.261414 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 601/1201] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:58 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 33020 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:48:58.961578 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a4b07d3e-378d-4262-9fd0-41b1587d8404 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:58.962680 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a4b07d3e-378d-4262-9fd0-41b1587d8404 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:58.969876 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4b07d3e-378d-4262-9fd0-41b1587d8404 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:58.970310 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4b07d3e-378d-4262-9fd0-41b1587d8404 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:58.971099 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4b07d3e-378d-4262-9fd0-41b1587d8404 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:58.971523 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4b07d3e-378d-4262-9fd0-41b1587d8404 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:59.037407 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a4b07d3e-378d-4262-9fd0-41b1587d8404 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28215 microversion: 2.1 time: 0.079704 Oct 28 08:48:59.038029 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 601/1202] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:48:58 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28215 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:48:59.273438 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-98d630f5-b9b6-45ce-bf59-c03ac92a78c7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:48:59.274334 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-98d630f5-b9b6-45ce-bf59-c03ac92a78c7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:48:59.281101 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98d630f5-b9b6-45ce-bf59-c03ac92a78c7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:59.282233 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98d630f5-b9b6-45ce-bf59-c03ac92a78c7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:59.283025 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98d630f5-b9b6-45ce-bf59-c03ac92a78c7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:48:59.283451 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98d630f5-b9b6-45ce-bf59-c03ac92a78c7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:48:59.361417 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-98d630f5-b9b6-45ce-bf59-c03ac92a78c7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 33765 microversion: 2.20 time: 0.092001 Oct 28 08:48:59.362046 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 602/1203] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:48:59 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 33765 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:00.049579 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2c24a7a3-623d-40f9-9c3e-ffb0883e0546 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:00.050459 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2c24a7a3-623d-40f9-9c3e-ffb0883e0546 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:00.057388 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c24a7a3-623d-40f9-9c3e-ffb0883e0546 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:00.057830 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c24a7a3-623d-40f9-9c3e-ffb0883e0546 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:00.058622 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c24a7a3-623d-40f9-9c3e-ffb0883e0546 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:00.059049 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c24a7a3-623d-40f9-9c3e-ffb0883e0546 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:00.133132 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2c24a7a3-623d-40f9-9c3e-ffb0883e0546 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28215 microversion: 2.1 time: 0.088200 Oct 28 08:49:00.134533 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 602/1204] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:00 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:00.373149 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8f1b4816-1332-4726-b3b2-8bcf89fb1918 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:00.374138 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8f1b4816-1332-4726-b3b2-8bcf89fb1918 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:00.381167 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f1b4816-1332-4726-b3b2-8bcf89fb1918 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:00.381582 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f1b4816-1332-4726-b3b2-8bcf89fb1918 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:00.382339 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f1b4816-1332-4726-b3b2-8bcf89fb1918 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:00.382787 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f1b4816-1332-4726-b3b2-8bcf89fb1918 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:00.465461 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8f1b4816-1332-4726-b3b2-8bcf89fb1918 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 34942 microversion: 2.20 time: 0.096285 Oct 28 08:49:00.466100 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 603/1205] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:00 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 34942 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:49:01.145989 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5ca6ea96-29c2-4109-beb4-ae08d0439b65 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:01.146974 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5ca6ea96-29c2-4109-beb4-ae08d0439b65 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:01.153738 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ca6ea96-29c2-4109-beb4-ae08d0439b65 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:01.154184 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ca6ea96-29c2-4109-beb4-ae08d0439b65 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:01.154984 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ca6ea96-29c2-4109-beb4-ae08d0439b65 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:01.155418 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ca6ea96-29c2-4109-beb4-ae08d0439b65 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:01.226918 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5ca6ea96-29c2-4109-beb4-ae08d0439b65 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28215 microversion: 2.1 time: 0.085566 Oct 28 08:49:01.227830 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 603/1206] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:01 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:01.478413 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e99d3973-6ee1-4129-b273-abea3404c15f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:01.479387 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e99d3973-6ee1-4129-b273-abea3404c15f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:01.487154 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e99d3973-6ee1-4129-b273-abea3404c15f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:01.487945 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e99d3973-6ee1-4129-b273-abea3404c15f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:01.488739 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e99d3973-6ee1-4129-b273-abea3404c15f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:01.489176 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e99d3973-6ee1-4129-b273-abea3404c15f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:01.578894 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e99d3973-6ee1-4129-b273-abea3404c15f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 35849 microversion: 2.20 time: 0.104876 Oct 28 08:49:01.580662 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 604/1207] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:01 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 35849 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:49:02.239866 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b7294a1d-f698-4fdd-a0ca-2f441ad2ae91 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:02.240869 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b7294a1d-f698-4fdd-a0ca-2f441ad2ae91 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:02.247820 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7294a1d-f698-4fdd-a0ca-2f441ad2ae91 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:02.248266 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7294a1d-f698-4fdd-a0ca-2f441ad2ae91 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:02.249080 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7294a1d-f698-4fdd-a0ca-2f441ad2ae91 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:02.249464 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7294a1d-f698-4fdd-a0ca-2f441ad2ae91 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:02.318335 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b7294a1d-f698-4fdd-a0ca-2f441ad2ae91 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28215 microversion: 2.1 time: 0.083144 Oct 28 08:49:02.319277 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 604/1208] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:02 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:02.592011 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e17d27c8-9ace-4289-bd0e-2e39e80997fd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:02.593005 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e17d27c8-9ace-4289-bd0e-2e39e80997fd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:02.600505 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e17d27c8-9ace-4289-bd0e-2e39e80997fd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:02.600939 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e17d27c8-9ace-4289-bd0e-2e39e80997fd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:02.601694 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e17d27c8-9ace-4289-bd0e-2e39e80997fd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:02.602118 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e17d27c8-9ace-4289-bd0e-2e39e80997fd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:02.688490 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e17d27c8-9ace-4289-bd0e-2e39e80997fd tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 37109 microversion: 2.20 time: 0.100628 Oct 28 08:49:02.689661 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 605/1209] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:02 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 37109 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:03.330215 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b56d4b8d-f35c-490f-9a00-524cc864565c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:03.331264 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b56d4b8d-f35c-490f-9a00-524cc864565c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:03.338169 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b56d4b8d-f35c-490f-9a00-524cc864565c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:03.338900 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b56d4b8d-f35c-490f-9a00-524cc864565c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:03.339669 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b56d4b8d-f35c-490f-9a00-524cc864565c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:03.340100 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b56d4b8d-f35c-490f-9a00-524cc864565c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:03.410941 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b56d4b8d-f35c-490f-9a00-524cc864565c tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28215 microversion: 2.1 time: 0.084445 Oct 28 08:49:03.411508 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 605/1210] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:03 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:03.700527 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-82ef0a75-60b7-43a4-b8c1-63329f8a281e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:03.701447 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-82ef0a75-60b7-43a4-b8c1-63329f8a281e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:03.709196 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82ef0a75-60b7-43a4-b8c1-63329f8a281e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:03.709640 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82ef0a75-60b7-43a4-b8c1-63329f8a281e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:03.710451 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82ef0a75-60b7-43a4-b8c1-63329f8a281e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:03.710945 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82ef0a75-60b7-43a4-b8c1-63329f8a281e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:03.808111 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-82ef0a75-60b7-43a4-b8c1-63329f8a281e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 38220 microversion: 2.20 time: 0.111554 Oct 28 08:49:03.808783 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 606/1211] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:03 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 38220 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:04.423141 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-992af7ca-05b8-4e9e-bbab-658d24478e7d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:04.424799 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-992af7ca-05b8-4e9e-bbab-658d24478e7d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:04.431692 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-992af7ca-05b8-4e9e-bbab-658d24478e7d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:04.432146 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-992af7ca-05b8-4e9e-bbab-658d24478e7d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:04.432918 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-992af7ca-05b8-4e9e-bbab-658d24478e7d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:04.433354 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-992af7ca-05b8-4e9e-bbab-658d24478e7d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:04.499095 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-992af7ca-05b8-4e9e-bbab-658d24478e7d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28215 microversion: 2.1 time: 0.079830 Oct 28 08:49:04.499774 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 606/1212] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:04 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28215 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:04.821135 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d09b7f2a-f772-49ba-941e-ce3ff10c7b76 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:04.822126 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d09b7f2a-f772-49ba-941e-ce3ff10c7b76 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:04.829093 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d09b7f2a-f772-49ba-941e-ce3ff10c7b76 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:04.829527 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d09b7f2a-f772-49ba-941e-ce3ff10c7b76 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:04.831087 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d09b7f2a-f772-49ba-941e-ce3ff10c7b76 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:04.831512 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d09b7f2a-f772-49ba-941e-ce3ff10c7b76 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:04.900363 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d09b7f2a-f772-49ba-941e-ce3ff10c7b76 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 38220 microversion: 2.20 time: 0.083063 Oct 28 08:49:04.901024 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 607/1213] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:04 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 38220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:05.511426 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8edd3bbf-9212-432f-b096-e0549606d8b3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:05.512430 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8edd3bbf-9212-432f-b096-e0549606d8b3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:05.519721 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8edd3bbf-9212-432f-b096-e0549606d8b3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:05.520158 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8edd3bbf-9212-432f-b096-e0549606d8b3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:05.520911 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8edd3bbf-9212-432f-b096-e0549606d8b3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:05.521335 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8edd3bbf-9212-432f-b096-e0549606d8b3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:05.597819 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8edd3bbf-9212-432f-b096-e0549606d8b3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28506 microversion: 2.1 time: 0.090246 Oct 28 08:49:05.598464 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 607/1214] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:05 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28506 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:05.913514 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6cdb50d9-4ca7-4248-8feb-f724de412957 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:05.914581 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6cdb50d9-4ca7-4248-8feb-f724de412957 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:05.921403 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6cdb50d9-4ca7-4248-8feb-f724de412957 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:05.921833 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6cdb50d9-4ca7-4248-8feb-f724de412957 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:05.922617 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6cdb50d9-4ca7-4248-8feb-f724de412957 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:05.923049 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6cdb50d9-4ca7-4248-8feb-f724de412957 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:05.992423 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6cdb50d9-4ca7-4248-8feb-f724de412957 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 38220 microversion: 2.20 time: 0.082703 Oct 28 08:49:05.993197 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 608/1215] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:05 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 38220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:49:06.609664 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-28da11a1-f7ef-4415-977a-95d015a91723 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:06.610705 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-28da11a1-f7ef-4415-977a-95d015a91723 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:06.617501 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28da11a1-f7ef-4415-977a-95d015a91723 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:06.617949 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28da11a1-f7ef-4415-977a-95d015a91723 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:06.618757 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28da11a1-f7ef-4415-977a-95d015a91723 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:06.619194 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28da11a1-f7ef-4415-977a-95d015a91723 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:06.688562 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-28da11a1-f7ef-4415-977a-95d015a91723 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28506 microversion: 2.1 time: 0.083032 Oct 28 08:49:06.689745 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 608/1216] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:06 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28506 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:07.005795 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a1bd2003-a310-4ceb-959b-6ffa32a54fc1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:07.006740 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a1bd2003-a310-4ceb-959b-6ffa32a54fc1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:07.013854 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1bd2003-a310-4ceb-959b-6ffa32a54fc1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:07.014297 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1bd2003-a310-4ceb-959b-6ffa32a54fc1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:07.015121 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1bd2003-a310-4ceb-959b-6ffa32a54fc1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:07.015547 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1bd2003-a310-4ceb-959b-6ffa32a54fc1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:07.089154 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a1bd2003-a310-4ceb-959b-6ffa32a54fc1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 38220 microversion: 2.20 time: 0.087634 Oct 28 08:49:07.089808 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 609/1217] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:06 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 38220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:07.701419 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e1f9c15e-9803-4d0f-87f7-2bea83e2ae13 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:07.702409 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e1f9c15e-9803-4d0f-87f7-2bea83e2ae13 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:07.709725 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1f9c15e-9803-4d0f-87f7-2bea83e2ae13 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:07.710168 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1f9c15e-9803-4d0f-87f7-2bea83e2ae13 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:07.710968 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1f9c15e-9803-4d0f-87f7-2bea83e2ae13 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:07.711392 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1f9c15e-9803-4d0f-87f7-2bea83e2ae13 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:07.802907 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e1f9c15e-9803-4d0f-87f7-2bea83e2ae13 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.105311 Oct 28 08:49:07.804315 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 609/1218] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:07 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:08.102425 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e095e432-8fb8-4ced-acc9-66446e12202d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:08.103621 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e095e432-8fb8-4ced-acc9-66446e12202d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:08.110463 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e095e432-8fb8-4ced-acc9-66446e12202d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:08.111113 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e095e432-8fb8-4ced-acc9-66446e12202d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:08.112455 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e095e432-8fb8-4ced-acc9-66446e12202d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:08.112890 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e095e432-8fb8-4ced-acc9-66446e12202d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:08.191912 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e095e432-8fb8-4ced-acc9-66446e12202d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 200 len: 38363 microversion: 2.20 time: 0.093460 Oct 28 08:49:08.192556 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 610/1219] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:08 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 38363 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:49:08.202713 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-84afd446-b2e5-47ab-926c-32e661012ff5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:08.203291 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-84afd446-b2e5-47ab-926c-32e661012ff5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:08.211186 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84afd446-b2e5-47ab-926c-32e661012ff5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:08.211631 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84afd446-b2e5-47ab-926c-32e661012ff5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:08.212393 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84afd446-b2e5-47ab-926c-32e661012ff5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:08.212825 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84afd446-b2e5-47ab-926c-32e661012ff5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:08.236812 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-84afd446-b2e5-47ab-926c-32e661012ff5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/ips" status: 200 len: 151 microversion: 2.20 time: 0.037962 Oct 28 08:49:08.237383 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 610/1220] 10.222.0.76 () {60 vars in 1288 bytes} [Thu Oct 28 08:49:08 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:08.815769 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bd20aa43-5954-4453-8d57-87b2abe29906 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:08.816812 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bd20aa43-5954-4453-8d57-87b2abe29906 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:08.823834 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd20aa43-5954-4453-8d57-87b2abe29906 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:08.824286 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd20aa43-5954-4453-8d57-87b2abe29906 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:08.825061 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd20aa43-5954-4453-8d57-87b2abe29906 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:08.825498 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd20aa43-5954-4453-8d57-87b2abe29906 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:08.889822 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bd20aa43-5954-4453-8d57-87b2abe29906 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.078712 Oct 28 08:49:08.890480 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 611/1221] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:08 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:09.901359 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8acf0d79-0093-485b-b741-fd796483857b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:09.902263 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8acf0d79-0093-485b-b741-fd796483857b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:09.908532 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8acf0d79-0093-485b-b741-fd796483857b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:09.908975 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8acf0d79-0093-485b-b741-fd796483857b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:09.909743 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8acf0d79-0093-485b-b741-fd796483857b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:09.910174 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8acf0d79-0093-485b-b741-fd796483857b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:09.969867 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8acf0d79-0093-485b-b741-fd796483857b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.072015 Oct 28 08:49:09.970736 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 611/1222] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:09 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:10.549335 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-28e69c29-93a6-4562-a836-a0a8f42c4b27 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:10.549941 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-28e69c29-93a6-4562-a836-a0a8f42c4b27 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:10.556887 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28e69c29-93a6-4562-a836-a0a8f42c4b27 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:10.557319 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28e69c29-93a6-4562-a836-a0a8f42c4b27 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:10.558089 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28e69c29-93a6-4562-a836-a0a8f42c4b27 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:10.558521 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28e69c29-93a6-4562-a836-a0a8f42c4b27 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:10.585575 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-28e69c29-93a6-4562-a836-a0a8f42c4b27 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lazy-loading 'flavor' on Instance uuid acd087a0-4efb-4b0c-83f8-dc9577976ee7 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:49:10.843093 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-28e69c29-93a6-4562-a836-a0a8f42c4b27 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 202 len: 0 microversion: 2.20 time: 0.297990 Oct 28 08:49:10.843822 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 612/1223] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:10 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:49:10.853223 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e5248785-d0cc-48b7-951f-81e24e503021 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:10.853921 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e5248785-d0cc-48b7-951f-81e24e503021 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:10.861871 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5248785-d0cc-48b7-951f-81e24e503021 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:10.862367 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5248785-d0cc-48b7-951f-81e24e503021 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:10.863175 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5248785-d0cc-48b7-951f-81e24e503021 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:10.863606 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5248785-d0cc-48b7-951f-81e24e503021 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:10.982793 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c343eb0e-9ae5-4df4-9bde-feb334443922 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:10.983929 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c343eb0e-9ae5-4df4-9bde-feb334443922 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:10.990845 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c343eb0e-9ae5-4df4-9bde-feb334443922 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:10.991142 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c343eb0e-9ae5-4df4-9bde-feb334443922 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:10.991923 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c343eb0e-9ae5-4df4-9bde-feb334443922 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:10.992352 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c343eb0e-9ae5-4df4-9bde-feb334443922 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:10.993230 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-e5248785-d0cc-48b7-951f-81e24e503021 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:11.002366 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-e5248785-d0cc-48b7-951f-81e24e503021 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:11.003918 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-e5248785-d0cc-48b7-951f-81e24e503021 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:11.005090 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e5248785-d0cc-48b7-951f-81e24e503021 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1723 microversion: 2.20 time: 0.156364 Oct 28 08:49:11.005653 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 612/1224] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:10 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:49:11.061602 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c343eb0e-9ae5-4df4-9bde-feb334443922 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.083781 Oct 28 08:49:11.062237 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 613/1225] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:10 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:12.023667 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7d35e7e1-af52-4ed9-b674-fb6593fdb1db tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:12.024272 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7d35e7e1-af52-4ed9-b674-fb6593fdb1db tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:12.030571 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d35e7e1-af52-4ed9-b674-fb6593fdb1db tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:12.031015 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d35e7e1-af52-4ed9-b674-fb6593fdb1db tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:12.031772 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d35e7e1-af52-4ed9-b674-fb6593fdb1db tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:12.032212 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d35e7e1-af52-4ed9-b674-fb6593fdb1db tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:12.073614 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7ce2ec2c-ef37-47d8-8bf8-51856ea3781d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:12.074706 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7ce2ec2c-ef37-47d8-8bf8-51856ea3781d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:12.082379 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ce2ec2c-ef37-47d8-8bf8-51856ea3781d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:12.082859 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ce2ec2c-ef37-47d8-8bf8-51856ea3781d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:12.083645 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ce2ec2c-ef37-47d8-8bf8-51856ea3781d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:12.084080 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ce2ec2c-ef37-47d8-8bf8-51856ea3781d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:12.152501 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7ce2ec2c-ef37-47d8-8bf8-51856ea3781d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.082388 Oct 28 08:49:12.153607 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 614/1226] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:12 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:12.178932 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-7d35e7e1-af52-4ed9-b674-fb6593fdb1db tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:12.186823 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-7d35e7e1-af52-4ed9-b674-fb6593fdb1db tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:12.188330 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-7d35e7e1-af52-4ed9-b674-fb6593fdb1db tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:12.189498 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7d35e7e1-af52-4ed9-b674-fb6593fdb1db tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1723 microversion: 2.20 time: 0.169529 Oct 28 08:49:12.190065 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 613/1227] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:12 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:49:13.165434 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c7f73ade-d98c-443f-b639-d8a1d5eaba8d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:13.166431 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c7f73ade-d98c-443f-b639-d8a1d5eaba8d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:13.173424 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7f73ade-d98c-443f-b639-d8a1d5eaba8d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:13.173909 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7f73ade-d98c-443f-b639-d8a1d5eaba8d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:13.174734 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7f73ade-d98c-443f-b639-d8a1d5eaba8d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:13.175183 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7f73ade-d98c-443f-b639-d8a1d5eaba8d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:13.208159 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6a206286-5b70-4c01-8965-356fd7e26bb4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:13.208765 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6a206286-5b70-4c01-8965-356fd7e26bb4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:13.215285 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a206286-5b70-4c01-8965-356fd7e26bb4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:13.215735 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a206286-5b70-4c01-8965-356fd7e26bb4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:13.216495 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a206286-5b70-4c01-8965-356fd7e26bb4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:13.216931 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a206286-5b70-4c01-8965-356fd7e26bb4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:13.241709 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c7f73ade-d98c-443f-b639-d8a1d5eaba8d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.080132 Oct 28 08:49:13.245706 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 615/1228] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:13 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:13.339755 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-6a206286-5b70-4c01-8965-356fd7e26bb4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:13.348583 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-6a206286-5b70-4c01-8965-356fd7e26bb4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:13.349987 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-6a206286-5b70-4c01-8965-356fd7e26bb4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:13.351187 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6a206286-5b70-4c01-8965-356fd7e26bb4 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1723 microversion: 2.20 time: 0.147395 Oct 28 08:49:13.351716 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 614/1229] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:13 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:49:14.254226 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6227432c-7a73-4df8-8a94-01e5de0dbd51 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:14.255180 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6227432c-7a73-4df8-8a94-01e5de0dbd51 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:14.261904 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6227432c-7a73-4df8-8a94-01e5de0dbd51 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:14.262339 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6227432c-7a73-4df8-8a94-01e5de0dbd51 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:14.263128 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6227432c-7a73-4df8-8a94-01e5de0dbd51 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:14.263551 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6227432c-7a73-4df8-8a94-01e5de0dbd51 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:14.330023 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6227432c-7a73-4df8-8a94-01e5de0dbd51 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.079428 Oct 28 08:49:14.330791 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 616/1230] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:14 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:14.368375 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-42bd0480-a875-40d0-aa73-347053eda5a0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:14.368987 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-42bd0480-a875-40d0-aa73-347053eda5a0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:14.375385 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42bd0480-a875-40d0-aa73-347053eda5a0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:14.375840 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42bd0480-a875-40d0-aa73-347053eda5a0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:14.376706 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42bd0480-a875-40d0-aa73-347053eda5a0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:14.377303 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42bd0480-a875-40d0-aa73-347053eda5a0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:14.498976 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-42bd0480-a875-40d0-aa73-347053eda5a0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:14.507281 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-42bd0480-a875-40d0-aa73-347053eda5a0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:14.508711 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-42bd0480-a875-40d0-aa73-347053eda5a0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:14.509866 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-42bd0480-a875-40d0-aa73-347053eda5a0 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1723 microversion: 2.20 time: 0.145217 Oct 28 08:49:14.510426 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 615/1231] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:14 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:49:15.344098 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e8b4c5f2-eb86-43bd-a11a-2130d0ed94c4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:15.346268 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e8b4c5f2-eb86-43bd-a11a-2130d0ed94c4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:15.353159 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8b4c5f2-eb86-43bd-a11a-2130d0ed94c4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:15.353552 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8b4c5f2-eb86-43bd-a11a-2130d0ed94c4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:15.354303 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8b4c5f2-eb86-43bd-a11a-2130d0ed94c4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:15.354753 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8b4c5f2-eb86-43bd-a11a-2130d0ed94c4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:15.430787 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e8b4c5f2-eb86-43bd-a11a-2130d0ed94c4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.090678 Oct 28 08:49:15.431448 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 617/1232] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:15 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:15.528688 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8dced4c8-57c9-496c-8221-6d6c431b781f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:15.529308 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8dced4c8-57c9-496c-8221-6d6c431b781f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:15.536344 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8dced4c8-57c9-496c-8221-6d6c431b781f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:15.536791 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8dced4c8-57c9-496c-8221-6d6c431b781f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:15.537556 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8dced4c8-57c9-496c-8221-6d6c431b781f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:15.537991 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8dced4c8-57c9-496c-8221-6d6c431b781f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:15.658968 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-8dced4c8-57c9-496c-8221-6d6c431b781f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:15.667060 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-8dced4c8-57c9-496c-8221-6d6c431b781f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:15.668537 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-8dced4c8-57c9-496c-8221-6d6c431b781f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:15.669683 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8dced4c8-57c9-496c-8221-6d6c431b781f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1723 microversion: 2.20 time: 0.144995 Oct 28 08:49:15.670231 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 616/1233] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:15 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:49:16.443638 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b5174f62-19fc-4c93-9615-4e4bd1df0904 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:16.444648 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b5174f62-19fc-4c93-9615-4e4bd1df0904 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:16.451482 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5174f62-19fc-4c93-9615-4e4bd1df0904 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:16.451924 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5174f62-19fc-4c93-9615-4e4bd1df0904 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:16.452685 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5174f62-19fc-4c93-9615-4e4bd1df0904 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:16.453117 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5174f62-19fc-4c93-9615-4e4bd1df0904 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:16.517471 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b5174f62-19fc-4c93-9615-4e4bd1df0904 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.078206 Oct 28 08:49:16.518364 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 618/1234] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:16 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:16.688184 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1cc445a7-d36f-479c-a60a-c5bcb75b35f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:16.688989 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1cc445a7-d36f-479c-a60a-c5bcb75b35f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:16.695912 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1cc445a7-d36f-479c-a60a-c5bcb75b35f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:16.696285 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1cc445a7-d36f-479c-a60a-c5bcb75b35f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:16.697037 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1cc445a7-d36f-479c-a60a-c5bcb75b35f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:16.697455 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1cc445a7-d36f-479c-a60a-c5bcb75b35f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:16.823288 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-1cc445a7-d36f-479c-a60a-c5bcb75b35f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:16.831670 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-1cc445a7-d36f-479c-a60a-c5bcb75b35f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:16.833146 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-1cc445a7-d36f-479c-a60a-c5bcb75b35f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:16.834325 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1cc445a7-d36f-479c-a60a-c5bcb75b35f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1723 microversion: 2.20 time: 0.149886 Oct 28 08:49:16.834925 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 617/1235] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:16 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:49:17.529771 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f8820b3c-e395-45a7-b17e-0f0f814a3786 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:17.530783 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f8820b3c-e395-45a7-b17e-0f0f814a3786 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:17.538755 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8820b3c-e395-45a7-b17e-0f0f814a3786 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:17.539186 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8820b3c-e395-45a7-b17e-0f0f814a3786 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:17.539938 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8820b3c-e395-45a7-b17e-0f0f814a3786 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:17.540361 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8820b3c-e395-45a7-b17e-0f0f814a3786 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:17.601682 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f8820b3c-e395-45a7-b17e-0f0f814a3786 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.075795 Oct 28 08:49:17.602579 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 619/1236] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:17 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:17.852508 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-303d59f1-6d75-4500-bcbf-56ab67cd657a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:17.853144 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-303d59f1-6d75-4500-bcbf-56ab67cd657a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:17.859494 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-303d59f1-6d75-4500-bcbf-56ab67cd657a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:17.859944 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-303d59f1-6d75-4500-bcbf-56ab67cd657a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:17.860771 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-303d59f1-6d75-4500-bcbf-56ab67cd657a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:17.861203 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-303d59f1-6d75-4500-bcbf-56ab67cd657a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:17.988216 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-303d59f1-6d75-4500-bcbf-56ab67cd657a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:17.996273 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-303d59f1-6d75-4500-bcbf-56ab67cd657a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:17.997762 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-303d59f1-6d75-4500-bcbf-56ab67cd657a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:17.998957 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-303d59f1-6d75-4500-bcbf-56ab67cd657a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1723 microversion: 2.20 time: 0.150192 Oct 28 08:49:17.999527 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 618/1237] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:17 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:49:18.615631 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a6819c43-35c1-46f6-8ba1-8bb2403919cd tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:18.616674 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a6819c43-35c1-46f6-8ba1-8bb2403919cd tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:18.623981 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6819c43-35c1-46f6-8ba1-8bb2403919cd tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:18.624423 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6819c43-35c1-46f6-8ba1-8bb2403919cd tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:18.625199 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6819c43-35c1-46f6-8ba1-8bb2403919cd tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:18.625625 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6819c43-35c1-46f6-8ba1-8bb2403919cd tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:18.692460 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a6819c43-35c1-46f6-8ba1-8bb2403919cd tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.082183 Oct 28 08:49:18.693130 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 620/1238] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:18 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:19.018198 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-35e47096-eb2f-4075-bd40-735c8e29b1ea tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:19.018766 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-35e47096-eb2f-4075-bd40-735c8e29b1ea tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:19.027155 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35e47096-eb2f-4075-bd40-735c8e29b1ea tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:19.027605 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35e47096-eb2f-4075-bd40-735c8e29b1ea tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:19.028406 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35e47096-eb2f-4075-bd40-735c8e29b1ea tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:19.028837 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35e47096-eb2f-4075-bd40-735c8e29b1ea tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:19.166179 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-35e47096-eb2f-4075-bd40-735c8e29b1ea tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:19.175426 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-35e47096-eb2f-4075-bd40-735c8e29b1ea tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:19.176909 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-35e47096-eb2f-4075-bd40-735c8e29b1ea tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:19.178210 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-35e47096-eb2f-4075-bd40-735c8e29b1ea tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1723 microversion: 2.20 time: 0.164742 Oct 28 08:49:19.179251 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 619/1239] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:19 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:49:19.709522 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b70c1258-7fd9-49ed-bb1f-9750512a45bf tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:19.710557 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b70c1258-7fd9-49ed-bb1f-9750512a45bf tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:19.717715 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b70c1258-7fd9-49ed-bb1f-9750512a45bf tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:19.718149 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b70c1258-7fd9-49ed-bb1f-9750512a45bf tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:19.718944 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b70c1258-7fd9-49ed-bb1f-9750512a45bf tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:19.719457 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b70c1258-7fd9-49ed-bb1f-9750512a45bf tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:19.789206 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b70c1258-7fd9-49ed-bb1f-9750512a45bf tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.087645 Oct 28 08:49:19.790386 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 621/1240] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:19 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:20.197358 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e0d2f6ca-63b3-4f73-9397-c47ce59b092e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:20.197963 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e0d2f6ca-63b3-4f73-9397-c47ce59b092e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:20.204813 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0d2f6ca-63b3-4f73-9397-c47ce59b092e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:20.205300 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0d2f6ca-63b3-4f73-9397-c47ce59b092e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:20.206072 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0d2f6ca-63b3-4f73-9397-c47ce59b092e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:20.206525 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0d2f6ca-63b3-4f73-9397-c47ce59b092e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:20.333738 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-e0d2f6ca-63b3-4f73-9397-c47ce59b092e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:20.341794 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-e0d2f6ca-63b3-4f73-9397-c47ce59b092e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:20.343330 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-e0d2f6ca-63b3-4f73-9397-c47ce59b092e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:20.344490 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e0d2f6ca-63b3-4f73-9397-c47ce59b092e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1723 microversion: 2.20 time: 0.150880 Oct 28 08:49:20.345829 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 620/1241] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:20 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:49:20.800881 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-02dc144f-f319-45a9-acaa-735aa7029d34 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:20.801894 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-02dc144f-f319-45a9-acaa-735aa7029d34 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:20.809191 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-02dc144f-f319-45a9-acaa-735aa7029d34 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:20.809632 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-02dc144f-f319-45a9-acaa-735aa7029d34 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:20.810406 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-02dc144f-f319-45a9-acaa-735aa7029d34 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:20.810855 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-02dc144f-f319-45a9-acaa-735aa7029d34 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:20.876848 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-02dc144f-f319-45a9-acaa-735aa7029d34 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.079819 Oct 28 08:49:20.877506 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 622/1242] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:20 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:21.364401 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c0f6f674-a5df-4246-9f2b-07c5445074b2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:21.364964 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c0f6f674-a5df-4246-9f2b-07c5445074b2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:21.371232 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0f6f674-a5df-4246-9f2b-07c5445074b2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:21.371678 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0f6f674-a5df-4246-9f2b-07c5445074b2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:21.372446 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0f6f674-a5df-4246-9f2b-07c5445074b2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:21.372880 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0f6f674-a5df-4246-9f2b-07c5445074b2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:21.499934 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c0f6f674-a5df-4246-9f2b-07c5445074b2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:21.508433 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c0f6f674-a5df-4246-9f2b-07c5445074b2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:21.509944 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c0f6f674-a5df-4246-9f2b-07c5445074b2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:21.511126 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c0f6f674-a5df-4246-9f2b-07c5445074b2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1723 microversion: 2.20 time: 0.151377 Oct 28 08:49:21.511678 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 621/1243] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:21 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:49:21.889230 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0fb23a3e-cf64-4c10-a317-1e5185f265d0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:21.890297 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0fb23a3e-cf64-4c10-a317-1e5185f265d0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:21.897383 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fb23a3e-cf64-4c10-a317-1e5185f265d0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:21.897829 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fb23a3e-cf64-4c10-a317-1e5185f265d0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:21.898631 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fb23a3e-cf64-4c10-a317-1e5185f265d0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:21.899067 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fb23a3e-cf64-4c10-a317-1e5185f265d0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:22.312887 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0fb23a3e-cf64-4c10-a317-1e5185f265d0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.427521 Oct 28 08:49:22.313570 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 623/1244] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:21 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:22.530646 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-97d3fa43-5683-40bd-9ede-5b3e7a1bca98 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:22.531253 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-97d3fa43-5683-40bd-9ede-5b3e7a1bca98 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:22.537884 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97d3fa43-5683-40bd-9ede-5b3e7a1bca98 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:22.538333 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97d3fa43-5683-40bd-9ede-5b3e7a1bca98 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:22.539636 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97d3fa43-5683-40bd-9ede-5b3e7a1bca98 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:22.540151 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97d3fa43-5683-40bd-9ede-5b3e7a1bca98 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:22.666563 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-97d3fa43-5683-40bd-9ede-5b3e7a1bca98 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:22.674807 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-97d3fa43-5683-40bd-9ede-5b3e7a1bca98 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:22.676307 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-97d3fa43-5683-40bd-9ede-5b3e7a1bca98 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:22.677573 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-97d3fa43-5683-40bd-9ede-5b3e7a1bca98 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1744 microversion: 2.20 time: 0.151447 Oct 28 08:49:22.678134 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 622/1245] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:22 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:49:23.325446 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7ff9d47f-5baa-41c1-826f-07d4c4e92fe4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:23.326462 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7ff9d47f-5baa-41c1-826f-07d4c4e92fe4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:23.334225 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ff9d47f-5baa-41c1-826f-07d4c4e92fe4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:23.334688 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ff9d47f-5baa-41c1-826f-07d4c4e92fe4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:23.335459 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ff9d47f-5baa-41c1-826f-07d4c4e92fe4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:23.335879 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ff9d47f-5baa-41c1-826f-07d4c4e92fe4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:23.400804 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7ff9d47f-5baa-41c1-826f-07d4c4e92fe4 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.079133 Oct 28 08:49:23.401364 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 624/1246] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:23 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:23.696422 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7f730822-bf4e-4aa9-948b-fea5c051373f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:23.696963 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7f730822-bf4e-4aa9-948b-fea5c051373f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:23.703164 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f730822-bf4e-4aa9-948b-fea5c051373f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:23.703603 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f730822-bf4e-4aa9-948b-fea5c051373f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:23.705589 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f730822-bf4e-4aa9-948b-fea5c051373f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:23.706023 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f730822-bf4e-4aa9-948b-fea5c051373f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:23.847922 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-7f730822-bf4e-4aa9-948b-fea5c051373f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:23.856155 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-7f730822-bf4e-4aa9-948b-fea5c051373f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:23.857652 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-7f730822-bf4e-4aa9-948b-fea5c051373f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:23.858844 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7f730822-bf4e-4aa9-948b-fea5c051373f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1744 microversion: 2.20 time: 0.166348 Oct 28 08:49:23.859403 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 623/1247] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:23 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:49:24.414302 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-82244b26-731d-4e5d-8d97-3196966197de tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:24.415361 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-82244b26-731d-4e5d-8d97-3196966197de tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:24.422096 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82244b26-731d-4e5d-8d97-3196966197de tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:24.422572 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82244b26-731d-4e5d-8d97-3196966197de tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:24.423557 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82244b26-731d-4e5d-8d97-3196966197de tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:24.423904 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82244b26-731d-4e5d-8d97-3196966197de tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:24.489236 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-82244b26-731d-4e5d-8d97-3196966197de tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.078831 Oct 28 08:49:24.489907 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 625/1248] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:24 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:24.877259 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6f614307-0ff9-4eaf-ac02-99bb4aadc7f7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:24.877879 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6f614307-0ff9-4eaf-ac02-99bb4aadc7f7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:24.886453 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f614307-0ff9-4eaf-ac02-99bb4aadc7f7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:24.887254 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f614307-0ff9-4eaf-ac02-99bb4aadc7f7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:24.888564 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f614307-0ff9-4eaf-ac02-99bb4aadc7f7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:24.889326 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f614307-0ff9-4eaf-ac02-99bb4aadc7f7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:25.040503 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-6f614307-0ff9-4eaf-ac02-99bb4aadc7f7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:25.048273 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-6f614307-0ff9-4eaf-ac02-99bb4aadc7f7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:25.049768 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-6f614307-0ff9-4eaf-ac02-99bb4aadc7f7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:25.050950 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6f614307-0ff9-4eaf-ac02-99bb4aadc7f7 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1744 microversion: 2.20 time: 0.178110 Oct 28 08:49:25.051544 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 624/1249] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:24 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:49:25.502211 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-95541d40-281a-4702-af2a-2f6483e8406e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:25.503297 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-95541d40-281a-4702-af2a-2f6483e8406e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:25.510142 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95541d40-281a-4702-af2a-2f6483e8406e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:25.510636 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95541d40-281a-4702-af2a-2f6483e8406e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:25.511399 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95541d40-281a-4702-af2a-2f6483e8406e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:25.511824 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95541d40-281a-4702-af2a-2f6483e8406e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:25.573796 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-95541d40-281a-4702-af2a-2f6483e8406e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.076023 Oct 28 08:49:25.574432 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 626/1250] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:25 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:26.068652 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-033a29d1-2077-42c7-9637-e6c8a48c6c0a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:26.079376 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-033a29d1-2077-42c7-9637-e6c8a48c6c0a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:26.079376 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-033a29d1-2077-42c7-9637-e6c8a48c6c0a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:26.079376 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-033a29d1-2077-42c7-9637-e6c8a48c6c0a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:26.079376 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-033a29d1-2077-42c7-9637-e6c8a48c6c0a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:26.080294 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-033a29d1-2077-42c7-9637-e6c8a48c6c0a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:26.214239 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-033a29d1-2077-42c7-9637-e6c8a48c6c0a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:26.223843 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-033a29d1-2077-42c7-9637-e6c8a48c6c0a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:26.225334 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-033a29d1-2077-42c7-9637-e6c8a48c6c0a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:26.226527 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-033a29d1-2077-42c7-9637-e6c8a48c6c0a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1744 microversion: 2.20 time: 0.161700 Oct 28 08:49:26.227079 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 625/1251] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:26 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:49:26.489145 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-abb12d56-c67a-440c-a632-d84721139bbd req-583b831a-fa85-4209-a7be-1918b8a94b2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd087a0-4efb-4b0c-83f8-dc9577976ee7", "name": "network-vif-plugged", "status": "completed", "tag": "bd4afab1-47c9-4cd2-87f5-5d7b28f4e628"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:26.492386 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:49:26.492386 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:49:26.509379 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-abb12d56-c67a-440c-a632-d84721139bbd req-583b831a-fa85-4209-a7be-1918b8a94b2f service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:26.510375 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-abb12d56-c67a-440c-a632-d84721139bbd req-583b831a-fa85-4209-a7be-1918b8a94b2f service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:26.531311 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-abb12d56-c67a-440c-a632-d84721139bbd req-583b831a-fa85-4209-a7be-1918b8a94b2f service nova] Creating event network-vif-plugged:bd4afab1-47c9-4cd2-87f5-5d7b28f4e628 for instance acd087a0-4efb-4b0c-83f8-dc9577976ee7 on hv-cinder-81565 Oct 28 08:49:26.541670 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-abb12d56-c67a-440c-a632-d84721139bbd req-583b831a-fa85-4209-a7be-1918b8a94b2f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059342 Oct 28 08:49:26.542610 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 627/1252] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:49:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:49:26.586412 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0a3c33d9-795e-4c83-b942-4ec10da4fa77 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:26.587661 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0a3c33d9-795e-4c83-b942-4ec10da4fa77 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:26.596096 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a3c33d9-795e-4c83-b942-4ec10da4fa77 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:26.596672 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a3c33d9-795e-4c83-b942-4ec10da4fa77 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:26.598521 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a3c33d9-795e-4c83-b942-4ec10da4fa77 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:26.598521 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a3c33d9-795e-4c83-b942-4ec10da4fa77 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:26.668232 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0a3c33d9-795e-4c83-b942-4ec10da4fa77 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.085536 Oct 28 08:49:26.669149 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 626/1253] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:26 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:27.248355 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-59840f2f-5d7a-47af-a1e2-e411ce61bcdc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:27.249031 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-59840f2f-5d7a-47af-a1e2-e411ce61bcdc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:27.255817 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59840f2f-5d7a-47af-a1e2-e411ce61bcdc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:27.256258 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59840f2f-5d7a-47af-a1e2-e411ce61bcdc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:27.257015 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59840f2f-5d7a-47af-a1e2-e411ce61bcdc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:27.257437 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59840f2f-5d7a-47af-a1e2-e411ce61bcdc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:27.392291 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-59840f2f-5d7a-47af-a1e2-e411ce61bcdc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:27.400324 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-59840f2f-5d7a-47af-a1e2-e411ce61bcdc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:27.401818 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-59840f2f-5d7a-47af-a1e2-e411ce61bcdc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:27.403022 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-59840f2f-5d7a-47af-a1e2-e411ce61bcdc tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1744 microversion: 2.20 time: 0.161330 Oct 28 08:49:27.403591 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 628/1254] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:27 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:49:27.681909 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-16c81c77-f22a-44a2-b9d3-8d14b456c4ba tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:27.682852 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-16c81c77-f22a-44a2-b9d3-8d14b456c4ba tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:27.691096 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16c81c77-f22a-44a2-b9d3-8d14b456c4ba tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:27.691542 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16c81c77-f22a-44a2-b9d3-8d14b456c4ba tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:27.692310 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16c81c77-f22a-44a2-b9d3-8d14b456c4ba tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:27.692743 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16c81c77-f22a-44a2-b9d3-8d14b456c4ba tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:27.771250 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-16c81c77-f22a-44a2-b9d3-8d14b456c4ba tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.092983 Oct 28 08:49:27.772327 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 627/1255] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:27 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:28.421834 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fb806e16-9b8e-4028-ac5a-5cfd17cd0254 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:28.422457 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fb806e16-9b8e-4028-ac5a-5cfd17cd0254 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:28.430491 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb806e16-9b8e-4028-ac5a-5cfd17cd0254 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:28.430967 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb806e16-9b8e-4028-ac5a-5cfd17cd0254 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:28.431752 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb806e16-9b8e-4028-ac5a-5cfd17cd0254 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:28.432212 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb806e16-9b8e-4028-ac5a-5cfd17cd0254 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:28.581852 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-fb806e16-9b8e-4028-ac5a-5cfd17cd0254 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:28.590097 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-fb806e16-9b8e-4028-ac5a-5cfd17cd0254 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:28.591609 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-fb806e16-9b8e-4028-ac5a-5cfd17cd0254 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:28.592754 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fb806e16-9b8e-4028-ac5a-5cfd17cd0254 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1744 microversion: 2.20 time: 0.174667 Oct 28 08:49:28.593309 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 629/1256] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:28 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1744 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:49:28.785724 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aaad7be1-4d1a-45a1-80f5-1d6139cd86ed tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:28.786678 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-aaad7be1-4d1a-45a1-80f5-1d6139cd86ed tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:28.793667 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aaad7be1-4d1a-45a1-80f5-1d6139cd86ed tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:28.794098 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aaad7be1-4d1a-45a1-80f5-1d6139cd86ed tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:28.794892 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aaad7be1-4d1a-45a1-80f5-1d6139cd86ed tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:28.795329 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aaad7be1-4d1a-45a1-80f5-1d6139cd86ed tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:28.897653 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-aaad7be1-4d1a-45a1-80f5-1d6139cd86ed tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.117365 Oct 28 08:49:28.898408 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 628/1257] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:28 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:29.613402 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5c140529-03d0-4fd4-8409-e1bbb555d0a1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:29.614037 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5c140529-03d0-4fd4-8409-e1bbb555d0a1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:29.620992 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c140529-03d0-4fd4-8409-e1bbb555d0a1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:29.621440 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c140529-03d0-4fd4-8409-e1bbb555d0a1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:29.622422 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c140529-03d0-4fd4-8409-e1bbb555d0a1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:29.623232 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c140529-03d0-4fd4-8409-e1bbb555d0a1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:29.767862 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-5c140529-03d0-4fd4-8409-e1bbb555d0a1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:29.776762 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-5c140529-03d0-4fd4-8409-e1bbb555d0a1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:29.778643 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-5c140529-03d0-4fd4-8409-e1bbb555d0a1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:29.780083 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5c140529-03d0-4fd4-8409-e1bbb555d0a1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1739 microversion: 2.20 time: 0.171206 Oct 28 08:49:29.780721 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 630/1258] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:29 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:49:29.913213 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b3963e56-8391-4ca4-8184-2ca3ced8da89 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:29.915210 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b3963e56-8391-4ca4-8184-2ca3ced8da89 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:29.922469 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3963e56-8391-4ca4-8184-2ca3ced8da89 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:29.923513 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3963e56-8391-4ca4-8184-2ca3ced8da89 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:29.924890 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3963e56-8391-4ca4-8184-2ca3ced8da89 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:29.925556 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3963e56-8391-4ca4-8184-2ca3ced8da89 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:29.990567 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b3963e56-8391-4ca4-8184-2ca3ced8da89 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.081956 Oct 28 08:49:29.991309 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 629/1259] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:29 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:30.799740 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f4203ddd-f030-4d6d-aab7-17d30aefa755 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:30.800337 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f4203ddd-f030-4d6d-aab7-17d30aefa755 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:30.807237 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4203ddd-f030-4d6d-aab7-17d30aefa755 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:30.807848 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4203ddd-f030-4d6d-aab7-17d30aefa755 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:30.808613 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4203ddd-f030-4d6d-aab7-17d30aefa755 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:30.809227 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4203ddd-f030-4d6d-aab7-17d30aefa755 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:30.949014 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-f4203ddd-f030-4d6d-aab7-17d30aefa755 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:30.958755 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-f4203ddd-f030-4d6d-aab7-17d30aefa755 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:30.960189 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-f4203ddd-f030-4d6d-aab7-17d30aefa755 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:30.961399 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f4203ddd-f030-4d6d-aab7-17d30aefa755 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1739 microversion: 2.20 time: 0.166717 Oct 28 08:49:30.962161 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 631/1260] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:30 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:49:31.002222 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-21ae12e0-454f-4416-81e6-ebd2b96ef9f6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:31.003497 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-21ae12e0-454f-4416-81e6-ebd2b96ef9f6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:31.011562 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21ae12e0-454f-4416-81e6-ebd2b96ef9f6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:31.012004 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21ae12e0-454f-4416-81e6-ebd2b96ef9f6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:31.012804 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21ae12e0-454f-4416-81e6-ebd2b96ef9f6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:31.013228 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21ae12e0-454f-4416-81e6-ebd2b96ef9f6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:31.086887 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-21ae12e0-454f-4416-81e6-ebd2b96ef9f6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.088662 Oct 28 08:49:31.094780 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 630/1261] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:30 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:31.982727 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-17e39e19-4d53-4813-8f4d-f168fa8b182c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:31.983746 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-17e39e19-4d53-4813-8f4d-f168fa8b182c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:31.994770 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17e39e19-4d53-4813-8f4d-f168fa8b182c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:31.995562 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17e39e19-4d53-4813-8f4d-f168fa8b182c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:31.996937 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17e39e19-4d53-4813-8f4d-f168fa8b182c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:31.997906 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17e39e19-4d53-4813-8f4d-f168fa8b182c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:32.099919 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b5686b0a-491b-49c0-b6b5-0dadaa74fbed tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:32.101517 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b5686b0a-491b-49c0-b6b5-0dadaa74fbed tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:32.115190 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5686b0a-491b-49c0-b6b5-0dadaa74fbed tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:32.115963 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5686b0a-491b-49c0-b6b5-0dadaa74fbed tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:32.116995 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5686b0a-491b-49c0-b6b5-0dadaa74fbed tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:32.117436 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5686b0a-491b-49c0-b6b5-0dadaa74fbed tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:32.195180 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-17e39e19-4d53-4813-8f4d-f168fa8b182c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:32.203212 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b5686b0a-491b-49c0-b6b5-0dadaa74fbed tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.107381 Oct 28 08:49:32.204359 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 631/1262] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:32 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:32.207430 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-17e39e19-4d53-4813-8f4d-f168fa8b182c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:32.209448 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-17e39e19-4d53-4813-8f4d-f168fa8b182c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:32.214562 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-17e39e19-4d53-4813-8f4d-f168fa8b182c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1739 microversion: 2.20 time: 0.232432 Oct 28 08:49:32.214562 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 632/1263] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:31 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:49:33.215531 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fcba63f3-abc3-4e22-8b0d-537a5fa62bf5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:33.216533 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fcba63f3-abc3-4e22-8b0d-537a5fa62bf5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:33.225120 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fcba63f3-abc3-4e22-8b0d-537a5fa62bf5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:33.229892 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3a86a703-2f47-4af1-a319-ee17a5fa8148 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:33.230480 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3a86a703-2f47-4af1-a319-ee17a5fa8148 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:33.233900 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fcba63f3-abc3-4e22-8b0d-537a5fa62bf5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:33.235526 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fcba63f3-abc3-4e22-8b0d-537a5fa62bf5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:33.236148 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fcba63f3-abc3-4e22-8b0d-537a5fa62bf5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:33.238119 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a86a703-2f47-4af1-a319-ee17a5fa8148 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:33.238589 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a86a703-2f47-4af1-a319-ee17a5fa8148 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:33.239563 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a86a703-2f47-4af1-a319-ee17a5fa8148 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:33.240154 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a86a703-2f47-4af1-a319-ee17a5fa8148 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:33.306343 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fcba63f3-abc3-4e22-8b0d-537a5fa62bf5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.093832 Oct 28 08:49:33.307219 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 632/1264] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:33 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:33.378297 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3a86a703-2f47-4af1-a319-ee17a5fa8148 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:33.388174 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3a86a703-2f47-4af1-a319-ee17a5fa8148 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:33.390702 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3a86a703-2f47-4af1-a319-ee17a5fa8148 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:33.392750 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3a86a703-2f47-4af1-a319-ee17a5fa8148 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1739 microversion: 2.20 time: 0.166439 Oct 28 08:49:33.393426 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 633/1265] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:33 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:49:34.098474 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 08:49:34.098676 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: Thu Oct 28 08:49:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 08:49:34.321536 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e670ac81-36bc-49d0-8367-985949ca93ba tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:34.322774 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e670ac81-36bc-49d0-8367-985949ca93ba tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:34.333347 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e670ac81-36bc-49d0-8367-985949ca93ba tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:34.334031 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e670ac81-36bc-49d0-8367-985949ca93ba tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:34.334917 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e670ac81-36bc-49d0-8367-985949ca93ba tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:34.335350 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e670ac81-36bc-49d0-8367-985949ca93ba tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:34.411687 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e670ac81-36bc-49d0-8367-985949ca93ba tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.094677 Oct 28 08:49:34.412827 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 633/1266] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:34 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:34.412962 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-db907bb2-7a11-44c9-88b4-bca42b90d24f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:34.413601 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-db907bb2-7a11-44c9-88b4-bca42b90d24f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:34.420914 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db907bb2-7a11-44c9-88b4-bca42b90d24f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:34.421715 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db907bb2-7a11-44c9-88b4-bca42b90d24f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:34.423091 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db907bb2-7a11-44c9-88b4-bca42b90d24f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:34.423664 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db907bb2-7a11-44c9-88b4-bca42b90d24f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:34.605489 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-db907bb2-7a11-44c9-88b4-bca42b90d24f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:34.616467 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-db907bb2-7a11-44c9-88b4-bca42b90d24f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:34.618643 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-db907bb2-7a11-44c9-88b4-bca42b90d24f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:34.620361 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-db907bb2-7a11-44c9-88b4-bca42b90d24f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1739 microversion: 2.20 time: 0.211046 Oct 28 08:49:34.631065 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 634/1267] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:34 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:49:35.425606 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8d96a8fa-a2d4-4285-b44a-2e63bf45e847 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:35.426820 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8d96a8fa-a2d4-4285-b44a-2e63bf45e847 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:35.433529 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d96a8fa-a2d4-4285-b44a-2e63bf45e847 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:35.434251 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d96a8fa-a2d4-4285-b44a-2e63bf45e847 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:35.435263 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d96a8fa-a2d4-4285-b44a-2e63bf45e847 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:35.435804 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d96a8fa-a2d4-4285-b44a-2e63bf45e847 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:35.513518 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8d96a8fa-a2d4-4285-b44a-2e63bf45e847 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.092455 Oct 28 08:49:35.514661 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 634/1268] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:35 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:35.637896 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-60c7719b-4666-4045-b206-61a07c4d7e4a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:35.638523 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-60c7719b-4666-4045-b206-61a07c4d7e4a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:35.646309 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60c7719b-4666-4045-b206-61a07c4d7e4a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:35.647037 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60c7719b-4666-4045-b206-61a07c4d7e4a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:35.648534 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60c7719b-4666-4045-b206-61a07c4d7e4a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:35.648849 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60c7719b-4666-4045-b206-61a07c4d7e4a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:35.807729 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-60c7719b-4666-4045-b206-61a07c4d7e4a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:35.817296 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-60c7719b-4666-4045-b206-61a07c4d7e4a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:35.818976 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-60c7719b-4666-4045-b206-61a07c4d7e4a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:35.820272 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-60c7719b-4666-4045-b206-61a07c4d7e4a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1739 microversion: 2.20 time: 0.186198 Oct 28 08:49:35.821082 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 635/1269] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:35 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:49:36.527648 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-47538155-71a2-4712-a82c-9c1479743a74 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:36.528639 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-47538155-71a2-4712-a82c-9c1479743a74 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:36.537255 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47538155-71a2-4712-a82c-9c1479743a74 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:36.537533 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47538155-71a2-4712-a82c-9c1479743a74 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:36.538345 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47538155-71a2-4712-a82c-9c1479743a74 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:36.538798 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47538155-71a2-4712-a82c-9c1479743a74 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:36.603171 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-47538155-71a2-4712-a82c-9c1479743a74 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.079404 Oct 28 08:49:36.604383 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 635/1270] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:36 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:36.839952 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-755177cd-f5b8-4dde-b12e-9b7be0fc9a5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:36.840632 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-755177cd-f5b8-4dde-b12e-9b7be0fc9a5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:36.847699 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-755177cd-f5b8-4dde-b12e-9b7be0fc9a5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:36.848105 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-755177cd-f5b8-4dde-b12e-9b7be0fc9a5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:36.848877 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-755177cd-f5b8-4dde-b12e-9b7be0fc9a5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:36.849296 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-755177cd-f5b8-4dde-b12e-9b7be0fc9a5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:37.013894 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-755177cd-f5b8-4dde-b12e-9b7be0fc9a5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:37.023721 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-755177cd-f5b8-4dde-b12e-9b7be0fc9a5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:37.025657 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-755177cd-f5b8-4dde-b12e-9b7be0fc9a5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:37.026895 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-755177cd-f5b8-4dde-b12e-9b7be0fc9a5b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1739 microversion: 2.20 time: 0.191665 Oct 28 08:49:37.027718 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 636/1271] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:36 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:49:37.617049 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c5439c37-c1f6-446f-845d-d6fb814022d0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:37.618069 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c5439c37-c1f6-446f-845d-d6fb814022d0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:37.625224 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5439c37-c1f6-446f-845d-d6fb814022d0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:37.626216 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5439c37-c1f6-446f-845d-d6fb814022d0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:37.626712 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5439c37-c1f6-446f-845d-d6fb814022d0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:37.627155 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5439c37-c1f6-446f-845d-d6fb814022d0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:37.694985 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c5439c37-c1f6-446f-845d-d6fb814022d0 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.081967 Oct 28 08:49:37.699447 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 636/1272] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:37 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:38.045296 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7c246f4e-fe49-4be4-a477-55d4030c1a73 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:38.047616 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7c246f4e-fe49-4be4-a477-55d4030c1a73 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:38.056692 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c246f4e-fe49-4be4-a477-55d4030c1a73 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:38.057274 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c246f4e-fe49-4be4-a477-55d4030c1a73 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:38.058081 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c246f4e-fe49-4be4-a477-55d4030c1a73 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:38.058492 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c246f4e-fe49-4be4-a477-55d4030c1a73 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:38.220141 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-7c246f4e-fe49-4be4-a477-55d4030c1a73 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:38.229044 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-7c246f4e-fe49-4be4-a477-55d4030c1a73 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:38.230750 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-7c246f4e-fe49-4be4-a477-55d4030c1a73 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:38.231993 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7c246f4e-fe49-4be4-a477-55d4030c1a73 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1739 microversion: 2.20 time: 0.190499 Oct 28 08:49:38.232576 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 637/1273] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:38 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:49:38.709174 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ad8ee13d-2dcd-4209-97e4-40fcda3554e6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:38.710181 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ad8ee13d-2dcd-4209-97e4-40fcda3554e6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:38.718201 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad8ee13d-2dcd-4209-97e4-40fcda3554e6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:38.718941 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad8ee13d-2dcd-4209-97e4-40fcda3554e6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:38.720551 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad8ee13d-2dcd-4209-97e4-40fcda3554e6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:38.721192 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad8ee13d-2dcd-4209-97e4-40fcda3554e6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:38.807801 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ad8ee13d-2dcd-4209-97e4-40fcda3554e6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.103948 Oct 28 08:49:38.812841 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 637/1274] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:38 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:39.251576 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3555996f-4d06-408e-bda6-677f7b93d74a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:39.252820 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3555996f-4d06-408e-bda6-677f7b93d74a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:39.259728 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3555996f-4d06-408e-bda6-677f7b93d74a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:39.260177 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3555996f-4d06-408e-bda6-677f7b93d74a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:39.260983 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3555996f-4d06-408e-bda6-677f7b93d74a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:39.261409 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3555996f-4d06-408e-bda6-677f7b93d74a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:39.403212 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3555996f-4d06-408e-bda6-677f7b93d74a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:39.412917 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3555996f-4d06-408e-bda6-677f7b93d74a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:39.414436 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3555996f-4d06-408e-bda6-677f7b93d74a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:39.415714 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3555996f-4d06-408e-bda6-677f7b93d74a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1739 microversion: 2.20 time: 0.168485 Oct 28 08:49:39.416598 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 638/1275] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:39 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:49:39.824748 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6d47bc87-09ca-4f11-a5d5-672d4b9191b3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:39.825717 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6d47bc87-09ca-4f11-a5d5-672d4b9191b3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:39.833929 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d47bc87-09ca-4f11-a5d5-672d4b9191b3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:39.834391 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d47bc87-09ca-4f11-a5d5-672d4b9191b3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:39.835219 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d47bc87-09ca-4f11-a5d5-672d4b9191b3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:39.835695 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d47bc87-09ca-4f11-a5d5-672d4b9191b3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:39.916909 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6d47bc87-09ca-4f11-a5d5-672d4b9191b3 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.099342 Oct 28 08:49:39.917568 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 638/1276] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:39 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 08:49:40.435306 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8157df21-b440-4f1a-93c7-535a09ddabf6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:40.435890 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8157df21-b440-4f1a-93c7-535a09ddabf6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:40.442259 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8157df21-b440-4f1a-93c7-535a09ddabf6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:40.442739 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8157df21-b440-4f1a-93c7-535a09ddabf6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:40.443503 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8157df21-b440-4f1a-93c7-535a09ddabf6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:40.443927 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8157df21-b440-4f1a-93c7-535a09ddabf6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:40.576044 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-8157df21-b440-4f1a-93c7-535a09ddabf6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:40.584841 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-8157df21-b440-4f1a-93c7-535a09ddabf6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:40.586339 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-8157df21-b440-4f1a-93c7-535a09ddabf6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:40.587535 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8157df21-b440-4f1a-93c7-535a09ddabf6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1739 microversion: 2.20 time: 0.156058 Oct 28 08:49:40.588500 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 639/1277] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:40 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:49:40.930243 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ac65920d-5d5d-45f8-90b8-9be900879e0b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:40.931288 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ac65920d-5d5d-45f8-90b8-9be900879e0b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:40.938816 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac65920d-5d5d-45f8-90b8-9be900879e0b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:40.939520 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac65920d-5d5d-45f8-90b8-9be900879e0b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:40.940386 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac65920d-5d5d-45f8-90b8-9be900879e0b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:40.940832 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac65920d-5d5d-45f8-90b8-9be900879e0b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:41.004764 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ac65920d-5d5d-45f8-90b8-9be900879e0b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.078660 Oct 28 08:49:41.008974 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 639/1278] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:40 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:41.607060 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e21a4c59-a0fb-4c33-a7cd-bf18ea936095 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:41.607661 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e21a4c59-a0fb-4c33-a7cd-bf18ea936095 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:41.614484 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e21a4c59-a0fb-4c33-a7cd-bf18ea936095 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:41.614967 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e21a4c59-a0fb-4c33-a7cd-bf18ea936095 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:41.616117 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e21a4c59-a0fb-4c33-a7cd-bf18ea936095 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:41.616551 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e21a4c59-a0fb-4c33-a7cd-bf18ea936095 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:41.749113 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-e21a4c59-a0fb-4c33-a7cd-bf18ea936095 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:41.758292 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-e21a4c59-a0fb-4c33-a7cd-bf18ea936095 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:41.760120 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-e21a4c59-a0fb-4c33-a7cd-bf18ea936095 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:41.761289 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e21a4c59-a0fb-4c33-a7cd-bf18ea936095 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1721 microversion: 2.20 time: 0.158395 Oct 28 08:49:41.761847 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 640/1279] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:41 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:49:42.017867 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-220c395e-a7bf-421c-add1-8ef339b7187d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:42.019031 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-220c395e-a7bf-421c-add1-8ef339b7187d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:42.026093 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-220c395e-a7bf-421c-add1-8ef339b7187d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:42.026555 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-220c395e-a7bf-421c-add1-8ef339b7187d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:42.027341 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-220c395e-a7bf-421c-add1-8ef339b7187d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:42.027776 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-220c395e-a7bf-421c-add1-8ef339b7187d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:42.104255 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-220c395e-a7bf-421c-add1-8ef339b7187d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.090783 Oct 28 08:49:42.105062 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 640/1280] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:42 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:42.779847 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e2299c0b-c410-4eb8-828f-198450aaf9ed tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:42.780539 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e2299c0b-c410-4eb8-828f-198450aaf9ed tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:42.787463 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2299c0b-c410-4eb8-828f-198450aaf9ed tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:42.787903 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2299c0b-c410-4eb8-828f-198450aaf9ed tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:42.788699 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2299c0b-c410-4eb8-828f-198450aaf9ed tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:42.789223 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2299c0b-c410-4eb8-828f-198450aaf9ed tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:42.914275 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-e2299c0b-c410-4eb8-828f-198450aaf9ed tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:42.923216 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-e2299c0b-c410-4eb8-828f-198450aaf9ed tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:42.924763 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-e2299c0b-c410-4eb8-828f-198450aaf9ed tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:42.925921 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e2299c0b-c410-4eb8-828f-198450aaf9ed tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1721 microversion: 2.20 time: 0.149993 Oct 28 08:49:42.926467 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 641/1281] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:42 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:49:43.116811 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0af92a89-af87-46ae-b7eb-d592ae076558 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:43.117852 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0af92a89-af87-46ae-b7eb-d592ae076558 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:43.124841 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0af92a89-af87-46ae-b7eb-d592ae076558 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:43.125292 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0af92a89-af87-46ae-b7eb-d592ae076558 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:43.126067 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0af92a89-af87-46ae-b7eb-d592ae076558 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:43.126533 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0af92a89-af87-46ae-b7eb-d592ae076558 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:43.213910 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0af92a89-af87-46ae-b7eb-d592ae076558 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 28674 microversion: 2.1 time: 0.100990 Oct 28 08:49:43.214592 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 641/1282] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:43 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 28674 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:43.944864 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-72b18c7c-4866-4f0d-8980-b5385740d067 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:43.945478 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-72b18c7c-4866-4f0d-8980-b5385740d067 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:43.951898 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72b18c7c-4866-4f0d-8980-b5385740d067 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:43.952344 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72b18c7c-4866-4f0d-8980-b5385740d067 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:43.953111 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72b18c7c-4866-4f0d-8980-b5385740d067 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:43.953542 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72b18c7c-4866-4f0d-8980-b5385740d067 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:44.077655 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-72b18c7c-4866-4f0d-8980-b5385740d067 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:44.085898 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-72b18c7c-4866-4f0d-8980-b5385740d067 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:44.087418 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-72b18c7c-4866-4f0d-8980-b5385740d067 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:44.088883 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-72b18c7c-4866-4f0d-8980-b5385740d067 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1664 microversion: 2.20 time: 0.147759 Oct 28 08:49:44.089432 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 642/1283] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:43 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1664 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:49:44.107276 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d699c227-5f80-474f-8949-af4ce5f46d18 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02053bcc-0b97-4bb9-80a5-3889227ae5e9"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:44.108445 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d699c227-5f80-474f-8949-af4ce5f46d18 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:44.116480 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d699c227-5f80-474f-8949-af4ce5f46d18 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:44.116917 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d699c227-5f80-474f-8949-af4ce5f46d18 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:44.117683 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d699c227-5f80-474f-8949-af4ce5f46d18 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:44.118141 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d699c227-5f80-474f-8949-af4ce5f46d18 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:44.225467 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d34feee3-0a1e-4db2-bf77-97b15f1188d8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:44.226380 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d34feee3-0a1e-4db2-bf77-97b15f1188d8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:44.232171 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d34feee3-0a1e-4db2-bf77-97b15f1188d8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:44.232610 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d34feee3-0a1e-4db2-bf77-97b15f1188d8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:44.233379 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d34feee3-0a1e-4db2-bf77-97b15f1188d8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:44.233870 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d34feee3-0a1e-4db2-bf77-97b15f1188d8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:44.327696 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d34feee3-0a1e-4db2-bf77-97b15f1188d8 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 30302 microversion: 2.1 time: 0.105475 Oct 28 08:49:44.328400 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 643/1284] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:44 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 30302 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:44.398192 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d699c227-5f80-474f-8949-af4ce5f46d18 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.295122 Oct 28 08:49:44.398938 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 642/1285] 10.222.0.76 () {62 vars in 1363 bytes} [Thu Oct 28 08:49:44 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/os-volume_attachments => generated 188 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:44.513409 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8cf4922a-e063-47a5-b279-fc5a16b407a9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:44.514145 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8cf4922a-e063-47a5-b279-fc5a16b407a9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:44.521794 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8cf4922a-e063-47a5-b279-fc5a16b407a9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:44.522355 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8cf4922a-e063-47a5-b279-fc5a16b407a9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:44.523231 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8cf4922a-e063-47a5-b279-fc5a16b407a9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:44.523747 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8cf4922a-e063-47a5-b279-fc5a16b407a9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:44.551273 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-1f597d1b-2dd2-4747-a5dc-df98c626cbd9 req-62fd3a83-99c1-4df0-8a33-df30abe879f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd087a0-4efb-4b0c-83f8-dc9577976ee7", "name": "network-vif-unplugged", "status": "completed", "tag": "bd4afab1-47c9-4cd2-87f5-5d7b28f4e628"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:44.552866 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:49:44.552866 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:49:44.564478 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-1f597d1b-2dd2-4747-a5dc-df98c626cbd9 req-62fd3a83-99c1-4df0-8a33-df30abe879f5 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:44.564998 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-1f597d1b-2dd2-4747-a5dc-df98c626cbd9 req-62fd3a83-99c1-4df0-8a33-df30abe879f5 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:44.581842 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.compute.server_external_events [req-1f597d1b-2dd2-4747-a5dc-df98c626cbd9 req-62fd3a83-99c1-4df0-8a33-df30abe879f5 service nova] Unable to find a host for instance acd087a0-4efb-4b0c-83f8-dc9577976ee7. Dropping event network-vif-unplugged {{(pid=122256) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Oct 28 08:49:44.582810 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-1f597d1b-2dd2-4747-a5dc-df98c626cbd9 req-62fd3a83-99c1-4df0-8a33-df30abe879f5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036424 Oct 28 08:49:44.583648 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 643/1286] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:49:44 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 08:49:44.783822 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8cf4922a-e063-47a5-b279-fc5a16b407a9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "DELETE /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/os-volume_attachments/02053bcc-0b97-4bb9-80a5-3889227ae5e9" status: 202 len: 0 microversion: 2.20 time: 0.274308 Oct 28 08:49:44.784521 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 644/1287] 10.222.0.76 () {60 vars in 1456 bytes} [Thu Oct 28 08:49:44 2021] DELETE /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/os-volume_attachments/02053bcc-0b97-4bb9-80a5-3889227ae5e9 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:49:44.840657 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1885a34c-7ecb-4ae6-b28e-8365f0bbf9cf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:44.841134 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1885a34c-7ecb-4ae6-b28e-8365f0bbf9cf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:44.848562 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1885a34c-7ecb-4ae6-b28e-8365f0bbf9cf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:44.849007 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1885a34c-7ecb-4ae6-b28e-8365f0bbf9cf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:44.849782 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1885a34c-7ecb-4ae6-b28e-8365f0bbf9cf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:44.850252 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1885a34c-7ecb-4ae6-b28e-8365f0bbf9cf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:44.929932 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1885a34c-7ecb-4ae6-b28e-8365f0bbf9cf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action" status: 202 len: 0 microversion: 2.20 time: 0.093375 Oct 28 08:49:44.930597 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 644/1288] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Oct 28 08:49:44 2021] POST /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:49:44.939372 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cc4e5057-d1d5-4307-bf6b-be0e3710350d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:44.940066 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cc4e5057-d1d5-4307-bf6b-be0e3710350d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:44.946797 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc4e5057-d1d5-4307-bf6b-be0e3710350d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:44.947402 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc4e5057-d1d5-4307-bf6b-be0e3710350d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:44.948001 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc4e5057-d1d5-4307-bf6b-be0e3710350d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:44.948430 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc4e5057-d1d5-4307-bf6b-be0e3710350d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:45.112968 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-cc4e5057-d1d5-4307-bf6b-be0e3710350d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:45.120996 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-cc4e5057-d1d5-4307-bf6b-be0e3710350d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:45.122507 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-cc4e5057-d1d5-4307-bf6b-be0e3710350d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:45.123668 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cc4e5057-d1d5-4307-bf6b-be0e3710350d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1672 microversion: 2.20 time: 0.188832 Oct 28 08:49:45.124221 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 645/1289] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:44 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1672 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:49:45.340718 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ee04b1a9-f233-437b-8a0d-394e3fc2b343 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:45.341805 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ee04b1a9-f233-437b-8a0d-394e3fc2b343 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:45.348414 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee04b1a9-f233-437b-8a0d-394e3fc2b343 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:45.348832 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee04b1a9-f233-437b-8a0d-394e3fc2b343 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:45.349742 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee04b1a9-f233-437b-8a0d-394e3fc2b343 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:45.350136 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee04b1a9-f233-437b-8a0d-394e3fc2b343 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:45.436109 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ee04b1a9-f233-437b-8a0d-394e3fc2b343 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 32125 microversion: 2.1 time: 0.099675 Oct 28 08:49:45.436765 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 645/1290] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:45 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 32125 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:46.142753 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-209a7371-6ba0-4add-804f-095f5cf06aae tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:46.143470 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-209a7371-6ba0-4add-804f-095f5cf06aae tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:46.149870 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-209a7371-6ba0-4add-804f-095f5cf06aae tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:46.150395 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-209a7371-6ba0-4add-804f-095f5cf06aae tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:46.151309 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-209a7371-6ba0-4add-804f-095f5cf06aae tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:46.151824 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-209a7371-6ba0-4add-804f-095f5cf06aae tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:46.329924 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-209a7371-6ba0-4add-804f-095f5cf06aae tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:46.338729 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-209a7371-6ba0-4add-804f-095f5cf06aae tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:46.340615 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-209a7371-6ba0-4add-804f-095f5cf06aae tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:46.341628 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-209a7371-6ba0-4add-804f-095f5cf06aae tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1730 microversion: 2.20 time: 0.202929 Oct 28 08:49:46.342178 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 646/1291] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:46 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:49:46.450197 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f8e52b46-5776-494b-8024-c163eff6a556 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:46.451217 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f8e52b46-5776-494b-8024-c163eff6a556 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:46.458615 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8e52b46-5776-494b-8024-c163eff6a556 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:46.459163 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8e52b46-5776-494b-8024-c163eff6a556 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:46.459943 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8e52b46-5776-494b-8024-c163eff6a556 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:46.460451 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8e52b46-5776-494b-8024-c163eff6a556 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:46.549953 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f8e52b46-5776-494b-8024-c163eff6a556 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 33426 microversion: 2.1 time: 0.103501 Oct 28 08:49:46.550705 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 646/1292] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:46 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 33426 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:49:47.360908 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7c5e5513-c411-4097-bd5c-4624b6fb1b75 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:47.361446 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7c5e5513-c411-4097-bd5c-4624b6fb1b75 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:47.367671 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c5e5513-c411-4097-bd5c-4624b6fb1b75 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:47.368118 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c5e5513-c411-4097-bd5c-4624b6fb1b75 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:47.368876 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c5e5513-c411-4097-bd5c-4624b6fb1b75 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:47.369301 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c5e5513-c411-4097-bd5c-4624b6fb1b75 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:47.498080 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-7c5e5513-c411-4097-bd5c-4624b6fb1b75 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:47.506847 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-7c5e5513-c411-4097-bd5c-4624b6fb1b75 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:47.508486 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-7c5e5513-c411-4097-bd5c-4624b6fb1b75 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:47.509673 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7c5e5513-c411-4097-bd5c-4624b6fb1b75 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1730 microversion: 2.20 time: 0.153261 Oct 28 08:49:47.510292 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 647/1293] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:47 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:49:47.561922 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-35732f7d-74f3-4cec-961d-d8496a0bad39 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:49:47.563657 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-35732f7d-74f3-4cec-961d-d8496a0bad39 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:47.570486 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35732f7d-74f3-4cec-961d-d8496a0bad39 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:47.570986 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35732f7d-74f3-4cec-961d-d8496a0bad39 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:47.571854 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35732f7d-74f3-4cec-961d-d8496a0bad39 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:47.572279 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35732f7d-74f3-4cec-961d-d8496a0bad39 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:48.527749 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-da09ad0b-738f-46c8-bfb4-fb5407228523 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:48.528735 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-da09ad0b-738f-46c8-bfb4-fb5407228523 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:48.535762 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da09ad0b-738f-46c8-bfb4-fb5407228523 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:48.536203 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da09ad0b-738f-46c8-bfb4-fb5407228523 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:48.536977 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da09ad0b-738f-46c8-bfb4-fb5407228523 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:48.537408 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da09ad0b-738f-46c8-bfb4-fb5407228523 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:48.667107 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-da09ad0b-738f-46c8-bfb4-fb5407228523 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:48.678210 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-da09ad0b-738f-46c8-bfb4-fb5407228523 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:48.679936 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-da09ad0b-738f-46c8-bfb4-fb5407228523 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:48.681110 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-da09ad0b-738f-46c8-bfb4-fb5407228523 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1730 microversion: 2.20 time: 0.157227 Oct 28 08:49:48.681675 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 648/1294] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:48 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:49:49.699744 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1edd4d90-00b3-495a-afa0-e23931d883bf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:49.700838 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1edd4d90-00b3-495a-afa0-e23931d883bf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:49.707805 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1edd4d90-00b3-495a-afa0-e23931d883bf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:49.708253 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1edd4d90-00b3-495a-afa0-e23931d883bf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:49.709034 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1edd4d90-00b3-495a-afa0-e23931d883bf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:49.709463 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1edd4d90-00b3-495a-afa0-e23931d883bf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:49.846791 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1edd4d90-00b3-495a-afa0-e23931d883bf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:49.857906 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1edd4d90-00b3-495a-afa0-e23931d883bf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:49.859945 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1edd4d90-00b3-495a-afa0-e23931d883bf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:49.861231 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1edd4d90-00b3-495a-afa0-e23931d883bf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1730 microversion: 2.20 time: 0.165220 Oct 28 08:49:49.861800 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 649/1295] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:49 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:49:50.880297 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ee258e61-dc50-4748-aa95-eb968d62e17d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:50.881744 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ee258e61-dc50-4748-aa95-eb968d62e17d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:50.888801 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee258e61-dc50-4748-aa95-eb968d62e17d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:50.890028 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee258e61-dc50-4748-aa95-eb968d62e17d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:50.891448 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee258e61-dc50-4748-aa95-eb968d62e17d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:50.891945 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee258e61-dc50-4748-aa95-eb968d62e17d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:51.023784 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-ee258e61-dc50-4748-aa95-eb968d62e17d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:51.032750 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-ee258e61-dc50-4748-aa95-eb968d62e17d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:51.034239 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-ee258e61-dc50-4748-aa95-eb968d62e17d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:51.035677 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ee258e61-dc50-4748-aa95-eb968d62e17d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1730 microversion: 2.20 time: 0.159241 Oct 28 08:49:51.036280 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 650/1296] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:50 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:49:52.053919 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d052ee55-bafd-4db7-9f00-21552a1d76b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:52.054656 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d052ee55-bafd-4db7-9f00-21552a1d76b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:52.062063 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d052ee55-bafd-4db7-9f00-21552a1d76b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:52.062621 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d052ee55-bafd-4db7-9f00-21552a1d76b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:52.063483 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d052ee55-bafd-4db7-9f00-21552a1d76b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:52.063986 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d052ee55-bafd-4db7-9f00-21552a1d76b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:52.217271 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-d052ee55-bafd-4db7-9f00-21552a1d76b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:52.228530 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-d052ee55-bafd-4db7-9f00-21552a1d76b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:52.230150 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-d052ee55-bafd-4db7-9f00-21552a1d76b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:52.231296 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d052ee55-bafd-4db7-9f00-21552a1d76b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1730 microversion: 2.20 time: 0.181247 Oct 28 08:49:52.232115 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 651/1297] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:52 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:49:53.250582 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-52f7048a-6443-40ae-9b10-c204af6c194b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:53.251596 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-52f7048a-6443-40ae-9b10-c204af6c194b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:53.257899 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-52f7048a-6443-40ae-9b10-c204af6c194b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:53.258340 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-52f7048a-6443-40ae-9b10-c204af6c194b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:53.259132 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-52f7048a-6443-40ae-9b10-c204af6c194b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:53.259579 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-52f7048a-6443-40ae-9b10-c204af6c194b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:53.535765 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-52f7048a-6443-40ae-9b10-c204af6c194b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:53.543695 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-52f7048a-6443-40ae-9b10-c204af6c194b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:53.545198 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-52f7048a-6443-40ae-9b10-c204af6c194b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:53.546365 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-52f7048a-6443-40ae-9b10-c204af6c194b tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1730 microversion: 2.20 time: 0.300143 Oct 28 08:49:53.547175 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 652/1298] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:53 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1730 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:49:54.564963 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9e5423ef-e0bc-43a6-a282-bbe96334616c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:54.566470 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9e5423ef-e0bc-43a6-a282-bbe96334616c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:54.577141 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e5423ef-e0bc-43a6-a282-bbe96334616c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:54.577141 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e5423ef-e0bc-43a6-a282-bbe96334616c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:54.577141 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e5423ef-e0bc-43a6-a282-bbe96334616c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:54.577141 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e5423ef-e0bc-43a6-a282-bbe96334616c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:54.708385 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-9e5423ef-e0bc-43a6-a282-bbe96334616c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:54.717063 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-9e5423ef-e0bc-43a6-a282-bbe96334616c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:54.719221 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-9e5423ef-e0bc-43a6-a282-bbe96334616c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:54.720376 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9e5423ef-e0bc-43a6-a282-bbe96334616c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1730 microversion: 2.20 time: 0.159368 Oct 28 08:49:54.720986 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 653/1299] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:54 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:49:55.740213 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0500728f-65a7-4396-ab1e-4c5e45898caf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:55.741532 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0500728f-65a7-4396-ab1e-4c5e45898caf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:55.748009 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0500728f-65a7-4396-ab1e-4c5e45898caf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:55.748461 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0500728f-65a7-4396-ab1e-4c5e45898caf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:55.749238 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0500728f-65a7-4396-ab1e-4c5e45898caf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:55.749763 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0500728f-65a7-4396-ab1e-4c5e45898caf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:55.883369 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-0500728f-65a7-4396-ab1e-4c5e45898caf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:55.891251 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-0500728f-65a7-4396-ab1e-4c5e45898caf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:55.893015 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-0500728f-65a7-4396-ab1e-4c5e45898caf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:55.894170 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0500728f-65a7-4396-ab1e-4c5e45898caf tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1730 microversion: 2.20 time: 0.158651 Oct 28 08:49:55.894771 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 654/1300] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:55 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:49:56.918424 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-374b677e-7b74-47d7-8a25-60f8cbdaf29a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:56.919568 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-374b677e-7b74-47d7-8a25-60f8cbdaf29a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:56.927770 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-374b677e-7b74-47d7-8a25-60f8cbdaf29a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:56.928589 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-374b677e-7b74-47d7-8a25-60f8cbdaf29a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:56.929770 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-374b677e-7b74-47d7-8a25-60f8cbdaf29a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:56.930438 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-374b677e-7b74-47d7-8a25-60f8cbdaf29a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:57.069023 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-374b677e-7b74-47d7-8a25-60f8cbdaf29a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:57.076849 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-374b677e-7b74-47d7-8a25-60f8cbdaf29a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:57.078987 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-374b677e-7b74-47d7-8a25-60f8cbdaf29a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:57.080153 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-374b677e-7b74-47d7-8a25-60f8cbdaf29a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1730 microversion: 2.20 time: 0.170846 Oct 28 08:49:57.080726 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 655/1301] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:56 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:49:58.098913 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e4c6d37b-62fb-4a9d-8933-e91e8fbf8764 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:58.099627 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e4c6d37b-62fb-4a9d-8933-e91e8fbf8764 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:58.108158 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4c6d37b-62fb-4a9d-8933-e91e8fbf8764 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:58.108594 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4c6d37b-62fb-4a9d-8933-e91e8fbf8764 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:58.110594 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4c6d37b-62fb-4a9d-8933-e91e8fbf8764 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:58.111025 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4c6d37b-62fb-4a9d-8933-e91e8fbf8764 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:58.248170 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-e4c6d37b-62fb-4a9d-8933-e91e8fbf8764 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:58.259696 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-e4c6d37b-62fb-4a9d-8933-e91e8fbf8764 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:58.262453 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-e4c6d37b-62fb-4a9d-8933-e91e8fbf8764 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:58.264658 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e4c6d37b-62fb-4a9d-8933-e91e8fbf8764 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1730 microversion: 2.20 time: 0.169248 Oct 28 08:49:58.267042 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 656/1302] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:58 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:49:59.283924 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-768bb871-9a61-4d35-a098-85b4e98f14c9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:49:59.284613 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-768bb871-9a61-4d35-a098-85b4e98f14c9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:49:59.291331 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-768bb871-9a61-4d35-a098-85b4e98f14c9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:59.291784 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-768bb871-9a61-4d35-a098-85b4e98f14c9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:59.292560 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-768bb871-9a61-4d35-a098-85b4e98f14c9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:49:59.292991 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-768bb871-9a61-4d35-a098-85b4e98f14c9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:49:59.422807 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-768bb871-9a61-4d35-a098-85b4e98f14c9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:59.430469 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-768bb871-9a61-4d35-a098-85b4e98f14c9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:59.431974 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-768bb871-9a61-4d35-a098-85b4e98f14c9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:49:59.433123 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-768bb871-9a61-4d35-a098-85b4e98f14c9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1730 microversion: 2.20 time: 0.153235 Oct 28 08:49:59.433682 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 657/1303] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:49:59 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:50:00.451406 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0f420474-0d20-4225-8a5a-926a5b5aaaea tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:00.452099 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0f420474-0d20-4225-8a5a-926a5b5aaaea tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:00.459494 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f420474-0d20-4225-8a5a-926a5b5aaaea tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:00.459961 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f420474-0d20-4225-8a5a-926a5b5aaaea tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:00.460730 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f420474-0d20-4225-8a5a-926a5b5aaaea tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:00.461159 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f420474-0d20-4225-8a5a-926a5b5aaaea tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:00.599002 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-0f420474-0d20-4225-8a5a-926a5b5aaaea tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:00.607870 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-0f420474-0d20-4225-8a5a-926a5b5aaaea tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:00.609684 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-0f420474-0d20-4225-8a5a-926a5b5aaaea tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:00.610987 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0f420474-0d20-4225-8a5a-926a5b5aaaea tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1730 microversion: 2.20 time: 0.163292 Oct 28 08:50:00.611542 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 658/1304] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:00 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:50:01.629968 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-aef93acb-cce6-4c18-8133-1c586836d39e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:01.630953 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-aef93acb-cce6-4c18-8133-1c586836d39e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:01.640048 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aef93acb-cce6-4c18-8133-1c586836d39e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:01.640665 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aef93acb-cce6-4c18-8133-1c586836d39e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:01.641721 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aef93acb-cce6-4c18-8133-1c586836d39e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:01.642259 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aef93acb-cce6-4c18-8133-1c586836d39e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:01.795718 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-aef93acb-cce6-4c18-8133-1c586836d39e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:01.804938 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-aef93acb-cce6-4c18-8133-1c586836d39e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:01.806479 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-aef93acb-cce6-4c18-8133-1c586836d39e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:01.807676 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-aef93acb-cce6-4c18-8133-1c586836d39e tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1730 microversion: 2.20 time: 0.181850 Oct 28 08:50:01.808239 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 659/1305] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:01 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:50:02.825748 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-071b8382-7490-4f72-b8df-d72029c4d323 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:02.826610 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-071b8382-7490-4f72-b8df-d72029c4d323 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:02.833885 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-071b8382-7490-4f72-b8df-d72029c4d323 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:02.834386 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-071b8382-7490-4f72-b8df-d72029c4d323 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:02.835357 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-071b8382-7490-4f72-b8df-d72029c4d323 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:02.835788 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-071b8382-7490-4f72-b8df-d72029c4d323 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:02.985486 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-071b8382-7490-4f72-b8df-d72029c4d323 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:02.996884 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-071b8382-7490-4f72-b8df-d72029c4d323 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:02.998372 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-071b8382-7490-4f72-b8df-d72029c4d323 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:03.000190 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-071b8382-7490-4f72-b8df-d72029c4d323 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1730 microversion: 2.20 time: 0.177882 Oct 28 08:50:03.000755 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 660/1306] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:02 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 08:50:03.548988 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-35732f7d-74f3-4cec-961d-d8496a0bad39 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action" status: 200 len: 38339 microversion: 2.1 time: 15.990877 Oct 28 08:50:03.549658 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 647/1307] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:49:47 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/action => generated 38339 bytes in 15993 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 08:50:03.665352 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-68e32b8b-9527-4961-90d6-38aa52017f5e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:03.665837 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-68e32b8b-9527-4961-90d6-38aa52017f5e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:03.673016 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-68e32b8b-9527-4961-90d6-38aa52017f5e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:03.673511 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-68e32b8b-9527-4961-90d6-38aa52017f5e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:03.674318 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-68e32b8b-9527-4961-90d6-38aa52017f5e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:03.674768 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-68e32b8b-9527-4961-90d6-38aa52017f5e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:03.701919 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-68e32b8b-9527-4961-90d6-38aa52017f5e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/ips" status: 200 len: 144 microversion: 2.1 time: 0.143328 Oct 28 08:50:03.702707 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 661/1308] 10.222.0.76 () {58 vars in 1247 bytes} [Thu Oct 28 08:50:03 2021] GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/ips => generated 144 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:50:04.019926 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1f601592-fc6b-4d0e-8bcd-3ad3e346fc7c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:04.020664 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1f601592-fc6b-4d0e-8bcd-3ad3e346fc7c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:04.028330 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f601592-fc6b-4d0e-8bcd-3ad3e346fc7c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:04.028781 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f601592-fc6b-4d0e-8bcd-3ad3e346fc7c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:04.029596 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f601592-fc6b-4d0e-8bcd-3ad3e346fc7c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:04.029979 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f601592-fc6b-4d0e-8bcd-3ad3e346fc7c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:04.464512 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-1f601592-fc6b-4d0e-8bcd-3ad3e346fc7c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:04.472768 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-1f601592-fc6b-4d0e-8bcd-3ad3e346fc7c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:04.474351 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-1f601592-fc6b-4d0e-8bcd-3ad3e346fc7c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:04.475554 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1f601592-fc6b-4d0e-8bcd-3ad3e346fc7c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1730 microversion: 2.20 time: 0.461019 Oct 28 08:50:04.476172 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 648/1309] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:04 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1730 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:05.032645 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-612df9f4-bb55-4f90-b96f-d6b8d804efe5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6c591c6-a08d-4a35-83d7-d2c93021fa74"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:05.033934 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-612df9f4-bb55-4f90-b96f-d6b8d804efe5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:05.040234 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-612df9f4-bb55-4f90-b96f-d6b8d804efe5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:05.040678 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-612df9f4-bb55-4f90-b96f-d6b8d804efe5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:05.041448 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-612df9f4-bb55-4f90-b96f-d6b8d804efe5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:05.041911 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-612df9f4-bb55-4f90-b96f-d6b8d804efe5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:05.334628 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-612df9f4-bb55-4f90-b96f-d6b8d804efe5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298823 Oct 28 08:50:05.341160 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 662/1310] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Oct 28 08:50:05 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:50:05.593678 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7146a760-42c6-4cad-98d2-f28753aad3d9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:05.594437 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7146a760-42c6-4cad-98d2-f28753aad3d9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:05.605669 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7146a760-42c6-4cad-98d2-f28753aad3d9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:05.606170 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7146a760-42c6-4cad-98d2-f28753aad3d9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:05.607124 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7146a760-42c6-4cad-98d2-f28753aad3d9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:05.607622 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7146a760-42c6-4cad-98d2-f28753aad3d9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:05.733103 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-7146a760-42c6-4cad-98d2-f28753aad3d9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:05.742283 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-7146a760-42c6-4cad-98d2-f28753aad3d9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:05.743836 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-7146a760-42c6-4cad-98d2-f28753aad3d9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:05.745010 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7146a760-42c6-4cad-98d2-f28753aad3d9 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1730 microversion: 2.20 time: 0.255289 Oct 28 08:50:05.745579 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 649/1311] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:05 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1730 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:06.765595 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-90ae7737-af94-492b-bc46-c33d07f7f737 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:06.766179 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-90ae7737-af94-492b-bc46-c33d07f7f737 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:06.774871 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90ae7737-af94-492b-bc46-c33d07f7f737 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:06.775393 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90ae7737-af94-492b-bc46-c33d07f7f737 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:06.776322 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90ae7737-af94-492b-bc46-c33d07f7f737 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:06.776791 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90ae7737-af94-492b-bc46-c33d07f7f737 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:06.915890 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-90ae7737-af94-492b-bc46-c33d07f7f737 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:06.923995 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-90ae7737-af94-492b-bc46-c33d07f7f737 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:06.925733 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-90ae7737-af94-492b-bc46-c33d07f7f737 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:06.926921 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-90ae7737-af94-492b-bc46-c33d07f7f737 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1730 microversion: 2.20 time: 0.166212 Oct 28 08:50:06.927479 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 663/1312] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:06 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:07.950175 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-57faea46-7d9c-4354-b86c-1f2852e11bbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:07.950914 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-57faea46-7d9c-4354-b86c-1f2852e11bbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:07.958097 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57faea46-7d9c-4354-b86c-1f2852e11bbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:07.958582 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57faea46-7d9c-4354-b86c-1f2852e11bbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:07.959357 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57faea46-7d9c-4354-b86c-1f2852e11bbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:07.959791 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57faea46-7d9c-4354-b86c-1f2852e11bbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:08.106820 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-57faea46-7d9c-4354-b86c-1f2852e11bbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:08.117360 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-57faea46-7d9c-4354-b86c-1f2852e11bbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:08.118885 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-57faea46-7d9c-4354-b86c-1f2852e11bbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:08.120057 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-57faea46-7d9c-4354-b86c-1f2852e11bbb tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1730 microversion: 2.20 time: 0.176445 Oct 28 08:50:08.120629 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 650/1313] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:07 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:08.775536 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-2889d538-109d-43f7-805c-038c9cb13895 req-10ebe064-5bb1-44b0-b857-37b734de8ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd087a0-4efb-4b0c-83f8-dc9577976ee7", "name": "network-vif-plugged", "status": "completed", "tag": "bd4afab1-47c9-4cd2-87f5-5d7b28f4e628"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:08.777194 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:50:08.777194 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:50:08.786001 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2889d538-109d-43f7-805c-038c9cb13895 req-10ebe064-5bb1-44b0-b857-37b734de8ac1 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:08.786535 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2889d538-109d-43f7-805c-038c9cb13895 req-10ebe064-5bb1-44b0-b857-37b734de8ac1 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:08.802589 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-2889d538-109d-43f7-805c-038c9cb13895 req-10ebe064-5bb1-44b0-b857-37b734de8ac1 service nova] Creating event network-vif-plugged:bd4afab1-47c9-4cd2-87f5-5d7b28f4e628 for instance acd087a0-4efb-4b0c-83f8-dc9577976ee7 on hv-cinder-81565 Oct 28 08:50:08.809356 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-2889d538-109d-43f7-805c-038c9cb13895 req-10ebe064-5bb1-44b0-b857-37b734de8ac1 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039980 Oct 28 08:50:08.810203 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 664/1314] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:50:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:50:09.139262 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-929eaab7-6394-4ba2-81ef-6e1e927bf4db tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:09.141054 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-929eaab7-6394-4ba2-81ef-6e1e927bf4db tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:09.146784 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-929eaab7-6394-4ba2-81ef-6e1e927bf4db tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:09.147235 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-929eaab7-6394-4ba2-81ef-6e1e927bf4db tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:09.148038 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-929eaab7-6394-4ba2-81ef-6e1e927bf4db tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:09.148475 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-929eaab7-6394-4ba2-81ef-6e1e927bf4db tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:09.274273 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-929eaab7-6394-4ba2-81ef-6e1e927bf4db tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:09.282970 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-929eaab7-6394-4ba2-81ef-6e1e927bf4db tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:09.284380 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-929eaab7-6394-4ba2-81ef-6e1e927bf4db tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:09.285550 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-929eaab7-6394-4ba2-81ef-6e1e927bf4db tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1730 microversion: 2.20 time: 0.150888 Oct 28 08:50:09.286117 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 651/1315] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:09 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:10.304568 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dc84aadb-5acc-45d4-8a3a-4179d9e85d46 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:10.305255 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dc84aadb-5acc-45d4-8a3a-4179d9e85d46 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:10.312760 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc84aadb-5acc-45d4-8a3a-4179d9e85d46 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:10.313202 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc84aadb-5acc-45d4-8a3a-4179d9e85d46 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:10.314060 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc84aadb-5acc-45d4-8a3a-4179d9e85d46 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:10.314454 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc84aadb-5acc-45d4-8a3a-4179d9e85d46 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:10.450592 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-dc84aadb-5acc-45d4-8a3a-4179d9e85d46 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:10.459259 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-dc84aadb-5acc-45d4-8a3a-4179d9e85d46 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:10.460739 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-dc84aadb-5acc-45d4-8a3a-4179d9e85d46 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:10.462164 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dc84aadb-5acc-45d4-8a3a-4179d9e85d46 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1730 microversion: 2.20 time: 0.161422 Oct 28 08:50:10.462755 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 665/1316] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:10 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:11.481471 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1dcdc680-54d0-480b-a67d-0c61fbcaed4c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:11.482053 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1dcdc680-54d0-480b-a67d-0c61fbcaed4c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:11.488864 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1dcdc680-54d0-480b-a67d-0c61fbcaed4c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:11.489306 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1dcdc680-54d0-480b-a67d-0c61fbcaed4c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:11.490078 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1dcdc680-54d0-480b-a67d-0c61fbcaed4c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:11.490528 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1dcdc680-54d0-480b-a67d-0c61fbcaed4c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:11.629912 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-1dcdc680-54d0-480b-a67d-0c61fbcaed4c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:11.638264 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-1dcdc680-54d0-480b-a67d-0c61fbcaed4c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:11.639864 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-1dcdc680-54d0-480b-a67d-0c61fbcaed4c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:11.641028 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1dcdc680-54d0-480b-a67d-0c61fbcaed4c tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1717 microversion: 2.20 time: 0.163544 Oct 28 08:50:11.641586 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 652/1317] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:50:11 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1717 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:50:12.853994 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fc2e1bf7-8e0e-485d-b9f7-97c5e2e14f7b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:12.854999 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fc2e1bf7-8e0e-485d-b9f7-97c5e2e14f7b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:12.863403 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc2e1bf7-8e0e-485d-b9f7-97c5e2e14f7b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:12.863847 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc2e1bf7-8e0e-485d-b9f7-97c5e2e14f7b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:12.864610 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc2e1bf7-8e0e-485d-b9f7-97c5e2e14f7b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:12.865039 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc2e1bf7-8e0e-485d-b9f7-97c5e2e14f7b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:12.903131 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fc2e1bf7-8e0e-485d-b9f7-97c5e2e14f7b tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052932 Oct 28 08:50:12.903694 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 666/1318] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Oct 28 08:50:12 2021] GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:50:12.915377 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-48c73e51-06c8-4d84-b77e-f5904c3e6e46 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:12.915985 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-48c73e51-06c8-4d84-b77e-f5904c3e6e46 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:12.927665 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48c73e51-06c8-4d84-b77e-f5904c3e6e46 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:12.928114 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48c73e51-06c8-4d84-b77e-f5904c3e6e46 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:12.928905 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48c73e51-06c8-4d84-b77e-f5904c3e6e46 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:12.929380 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48c73e51-06c8-4d84-b77e-f5904c3e6e46 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:12.966289 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-48c73e51-06c8-4d84-b77e-f5904c3e6e46 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/os-volume_attachments/f6c591c6-a08d-4a35-83d7-d2c93021fa74" status: 200 len: 194 microversion: 2.1 time: 0.054800 Oct 28 08:50:12.966948 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 653/1319] 10.222.0.76 () {58 vars in 1412 bytes} [Thu Oct 28 08:50:12 2021] GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/os-volume_attachments/f6c591c6-a08d-4a35-83d7-d2c93021fa74 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:50:14.311302 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9752f9eb-1643-4346-b44b-79a9d740959f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fb187af-74a9-4f95-adeb-5bbeec744f60"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:14.312296 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9752f9eb-1643-4346-b44b-79a9d740959f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:14.319440 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9752f9eb-1643-4346-b44b-79a9d740959f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:14.319882 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9752f9eb-1643-4346-b44b-79a9d740959f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:14.320745 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9752f9eb-1643-4346-b44b-79a9d740959f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:14.321265 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9752f9eb-1643-4346-b44b-79a9d740959f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:14.581809 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9752f9eb-1643-4346-b44b-79a9d740959f tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274272 Oct 28 08:50:14.582417 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 667/1320] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Oct 28 08:50:14 2021] POST /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:50:22.101858 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9461431d-f293-4188-84e4-6892b13c330e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:22.102868 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9461431d-f293-4188-84e4-6892b13c330e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:22.109882 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9461431d-f293-4188-84e4-6892b13c330e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:22.110363 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9461431d-f293-4188-84e4-6892b13c330e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:22.111426 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9461431d-f293-4188-84e4-6892b13c330e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:22.111934 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9461431d-f293-4188-84e4-6892b13c330e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:22.145191 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9461431d-f293-4188-84e4-6892b13c330e tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047091 Oct 28 08:50:22.145770 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 654/1321] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Oct 28 08:50:22 2021] GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:50:22.480735 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9686cee8-1c34-4d23-9f5e-62a960084573 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:22.481453 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9686cee8-1c34-4d23-9f5e-62a960084573 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:22.488787 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9686cee8-1c34-4d23-9f5e-62a960084573 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:22.489232 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9686cee8-1c34-4d23-9f5e-62a960084573 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:22.490010 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9686cee8-1c34-4d23-9f5e-62a960084573 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:22.490442 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9686cee8-1c34-4d23-9f5e-62a960084573 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:22.520002 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9686cee8-1c34-4d23-9f5e-62a960084573 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/os-volume_attachments/f6c591c6-a08d-4a35-83d7-d2c93021fa74" status: 200 len: 194 microversion: 2.1 time: 0.044077 Oct 28 08:50:22.520598 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 668/1322] 10.222.0.76 () {58 vars in 1412 bytes} [Thu Oct 28 08:50:22 2021] GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/os-volume_attachments/f6c591c6-a08d-4a35-83d7-d2c93021fa74 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:50:22.531104 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f459b5b2-ff1c-4b59-982e-2f5c631011b2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:22.531317 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f459b5b2-ff1c-4b59-982e-2f5c631011b2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:22.538055 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f459b5b2-ff1c-4b59-982e-2f5c631011b2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:22.538524 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f459b5b2-ff1c-4b59-982e-2f5c631011b2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:22.539284 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f459b5b2-ff1c-4b59-982e-2f5c631011b2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:22.539711 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f459b5b2-ff1c-4b59-982e-2f5c631011b2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:22.624670 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-f459b5b2-ff1c-4b59-982e-2f5c631011b2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lazy-loading 'services' on Instance uuid e7b330ee-3ee9-48ec-bd24-81e216ae78ae {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:50:22.697828 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f459b5b2-ff1c-4b59-982e-2f5c631011b2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/os-volume_attachments/f6c591c6-a08d-4a35-83d7-d2c93021fa74" status: 202 len: 0 microversion: 2.1 time: 0.171242 Oct 28 08:50:22.698420 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 655/1323] 10.222.0.76 () {58 vars in 1415 bytes} [Thu Oct 28 08:50:22 2021] DELETE /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/os-volume_attachments/f6c591c6-a08d-4a35-83d7-d2c93021fa74 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:50:24.874758 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3ac8ae15-728b-47ab-ad29-1b8b9e703700 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:24.875331 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3ac8ae15-728b-47ab-ad29-1b8b9e703700 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:24.882758 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3ac8ae15-728b-47ab-ad29-1b8b9e703700 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:24.883201 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3ac8ae15-728b-47ab-ad29-1b8b9e703700 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:24.883991 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3ac8ae15-728b-47ab-ad29-1b8b9e703700 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:24.884416 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3ac8ae15-728b-47ab-ad29-1b8b9e703700 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:24.918710 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3ac8ae15-728b-47ab-ad29-1b8b9e703700 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/os-volume_attachments/5fb187af-74a9-4f95-adeb-5bbeec744f60" status: 200 len: 194 microversion: 2.1 time: 0.047836 Oct 28 08:50:24.919329 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 669/1324] 10.222.0.76 () {58 vars in 1412 bytes} [Thu Oct 28 08:50:24 2021] GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/os-volume_attachments/5fb187af-74a9-4f95-adeb-5bbeec744f60 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:50:24.932159 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-64fab53b-db99-4c3e-bd3c-bb967def26f6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:24.932159 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-64fab53b-db99-4c3e-bd3c-bb967def26f6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:24.942723 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64fab53b-db99-4c3e-bd3c-bb967def26f6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:24.943169 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64fab53b-db99-4c3e-bd3c-bb967def26f6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:24.943960 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64fab53b-db99-4c3e-bd3c-bb967def26f6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:24.944390 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64fab53b-db99-4c3e-bd3c-bb967def26f6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:25.033882 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-64fab53b-db99-4c3e-bd3c-bb967def26f6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lazy-loading 'services' on Instance uuid e7b330ee-3ee9-48ec-bd24-81e216ae78ae {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:50:25.109871 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-64fab53b-db99-4c3e-bd3c-bb967def26f6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/os-volume_attachments/5fb187af-74a9-4f95-adeb-5bbeec744f60" status: 202 len: 0 microversion: 2.1 time: 0.182888 Oct 28 08:50:25.110725 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 656/1325] 10.222.0.76 () {58 vars in 1415 bytes} [Thu Oct 28 08:50:24 2021] DELETE /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/os-volume_attachments/5fb187af-74a9-4f95-adeb-5bbeec744f60 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:50:26.285925 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-07b2b5d1-e233-481f-a9d5-cc1f27e6da67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:26.287216 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-07b2b5d1-e233-481f-a9d5-cc1f27e6da67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:26.294010 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07b2b5d1-e233-481f-a9d5-cc1f27e6da67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:26.294382 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07b2b5d1-e233-481f-a9d5-cc1f27e6da67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:26.295837 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07b2b5d1-e233-481f-a9d5-cc1f27e6da67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:26.296379 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07b2b5d1-e233-481f-a9d5-cc1f27e6da67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:26.326637 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-07b2b5d1-e233-481f-a9d5-cc1f27e6da67 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044520 Oct 28 08:50:26.327584 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 670/1326] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Oct 28 08:50:26 2021] GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:50:26.437174 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3191b025-d092-49ef-b877-da4b97a6fada tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:26.438217 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3191b025-d092-49ef-b877-da4b97a6fada tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:26.444648 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3191b025-d092-49ef-b877-da4b97a6fada tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:26.445089 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3191b025-d092-49ef-b877-da4b97a6fada tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:26.445860 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3191b025-d092-49ef-b877-da4b97a6fada tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:26.446287 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3191b025-d092-49ef-b877-da4b97a6fada tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:26.477229 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3191b025-d092-49ef-b877-da4b97a6fada tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045046 Oct 28 08:50:26.477800 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 657/1327] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Oct 28 08:50:26 2021] GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:50:26.537277 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8707ca7e-61a4-482b-b856-aad76e8c1bf9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:26.537757 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8707ca7e-61a4-482b-b856-aad76e8c1bf9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:26.543593 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8707ca7e-61a4-482b-b856-aad76e8c1bf9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:26.544085 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8707ca7e-61a4-482b-b856-aad76e8c1bf9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:26.544788 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8707ca7e-61a4-482b-b856-aad76e8c1bf9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:26.545251 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8707ca7e-61a4-482b-b856-aad76e8c1bf9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:26.570665 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8707ca7e-61a4-482b-b856-aad76e8c1bf9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:50:26.667347 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8707ca7e-61a4-482b-b856-aad76e8c1bf9 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae" status: 204 len: 0 microversion: 2.1 time: 0.133056 Oct 28 08:50:26.668389 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 671/1328] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Oct 28 08:50:26 2021] DELETE /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 08:50:26.676447 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a1ad68b2-39b3-4fb4-9429-76c5dda52db5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:26.676447 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a1ad68b2-39b3-4fb4-9429-76c5dda52db5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:26.683559 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1ad68b2-39b3-4fb4-9429-76c5dda52db5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:26.684002 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1ad68b2-39b3-4fb4-9429-76c5dda52db5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:26.684761 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1ad68b2-39b3-4fb4-9429-76c5dda52db5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:26.685190 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1ad68b2-39b3-4fb4-9429-76c5dda52db5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:26.814187 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-a1ad68b2-39b3-4fb4-9429-76c5dda52db5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:26.822041 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a1ad68b2-39b3-4fb4-9429-76c5dda52db5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae" status: 200 len: 1672 microversion: 2.1 time: 0.149212 Oct 28 08:50:26.822647 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 658/1329] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:26 2021] GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:27.841306 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bc478fa9-bd3b-44ea-acc6-1569b7887c1d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:27.842529 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bc478fa9-bd3b-44ea-acc6-1569b7887c1d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:27.848870 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc478fa9-bd3b-44ea-acc6-1569b7887c1d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:27.849315 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc478fa9-bd3b-44ea-acc6-1569b7887c1d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:27.850094 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc478fa9-bd3b-44ea-acc6-1569b7887c1d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:27.850548 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc478fa9-bd3b-44ea-acc6-1569b7887c1d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:27.984440 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-bc478fa9-bd3b-44ea-acc6-1569b7887c1d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:27.992602 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bc478fa9-bd3b-44ea-acc6-1569b7887c1d tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae" status: 200 len: 1672 microversion: 2.1 time: 0.155248 Oct 28 08:50:27.993184 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 672/1330] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:27 2021] GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:29.011543 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e3a3c157-9e5d-4087-9cdd-ff58f2fde5c6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:29.012148 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e3a3c157-9e5d-4087-9cdd-ff58f2fde5c6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:29.019067 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3a3c157-9e5d-4087-9cdd-ff58f2fde5c6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:29.019512 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3a3c157-9e5d-4087-9cdd-ff58f2fde5c6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:29.020294 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3a3c157-9e5d-4087-9cdd-ff58f2fde5c6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:29.020720 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3a3c157-9e5d-4087-9cdd-ff58f2fde5c6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:29.259693 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-e3a3c157-9e5d-4087-9cdd-ff58f2fde5c6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:29.268069 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e3a3c157-9e5d-4087-9cdd-ff58f2fde5c6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae" status: 200 len: 1672 microversion: 2.1 time: 0.260806 Oct 28 08:50:29.268757 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 659/1331] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:29 2021] GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae => generated 1672 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:29.952551 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-ff32a39c-7b08-485c-8425-8f01cb4f3959 req-74ded7df-a98d-466a-bfd8-3913da373c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7b330ee-3ee9-48ec-bd24-81e216ae78ae", "name": "network-vif-deleted", "tag": "d06f77e6-19cf-4197-85ed-4921523a9bd2"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:29.955335 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:50:29.955335 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:50:29.971289 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-ff32a39c-7b08-485c-8425-8f01cb4f3959 req-74ded7df-a98d-466a-bfd8-3913da373c86 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:29.972050 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-ff32a39c-7b08-485c-8425-8f01cb4f3959 req-74ded7df-a98d-466a-bfd8-3913da373c86 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:29.984784 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-ff32a39c-7b08-485c-8425-8f01cb4f3959 req-74ded7df-a98d-466a-bfd8-3913da373c86 service nova] Creating event network-vif-deleted:d06f77e6-19cf-4197-85ed-4921523a9bd2 for instance e7b330ee-3ee9-48ec-bd24-81e216ae78ae on hv-cinder-81565 Oct 28 08:50:29.993725 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-ff32a39c-7b08-485c-8425-8f01cb4f3959 req-74ded7df-a98d-466a-bfd8-3913da373c86 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176374 Oct 28 08:50:29.994980 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 673/1332] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:50:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:50:30.289728 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e61bb61c-17a9-4cb1-9109-999792a0b3a6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:30.291263 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e61bb61c-17a9-4cb1-9109-999792a0b3a6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:30.300581 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e61bb61c-17a9-4cb1-9109-999792a0b3a6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:30.301361 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e61bb61c-17a9-4cb1-9109-999792a0b3a6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:30.302222 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e61bb61c-17a9-4cb1-9109-999792a0b3a6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:30.302760 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e61bb61c-17a9-4cb1-9109-999792a0b3a6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:30.359438 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e61bb61c-17a9-4cb1-9109-999792a0b3a6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:30.360104 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e61bb61c-17a9-4cb1-9109-999792a0b3a6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:30.361027 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-e61bb61c-17a9-4cb1-9109-999792a0b3a6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lazy-loading 'fault' on Instance uuid e7b330ee-3ee9-48ec-bd24-81e216ae78ae {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:50:30.432249 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-e61bb61c-17a9-4cb1-9109-999792a0b3a6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483af16bae1f4521ad3e3138bbc86123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12dfed3afe746b58b897b104b2a78ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:30.449681 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e61bb61c-17a9-4cb1-9109-999792a0b3a6 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae" status: 200 len: 1327 microversion: 2.1 time: 0.164496 Oct 28 08:50:30.453371 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 660/1333] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:30 2021] GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae => generated 1327 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:31.473205 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9e81b95d-77ad-4230-83d8-68cb25730267 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:31.474042 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9e81b95d-77ad-4230-83d8-68cb25730267 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:31.480787 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e81b95d-77ad-4230-83d8-68cb25730267 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:31.481221 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e81b95d-77ad-4230-83d8-68cb25730267 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:31.482006 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e81b95d-77ad-4230-83d8-68cb25730267 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:31.482444 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e81b95d-77ad-4230-83d8-68cb25730267 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:31.498859 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-9e81b95d-77ad-4230-83d8-68cb25730267 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] HTTP exception thrown: Instance e7b330ee-3ee9-48ec-bd24-81e216ae78ae could not be found. Oct 28 08:50:31.500155 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9e81b95d-77ad-4230-83d8-68cb25730267 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Returning 404 to user: Instance e7b330ee-3ee9-48ec-bd24-81e216ae78ae could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:50:31.501009 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9e81b95d-77ad-4230-83d8-68cb25730267 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae" status: 404 len: 111 microversion: 2.1 time: 0.033114 Oct 28 08:50:31.501589 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 674/1334] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:31 2021] GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:50:31.511110 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-98456234-2266-4f69-85b0-1ed566011245 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '.version_select at 0x7fed6ea815e0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:31.534050 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-98456234-2266-4f69-85b0-1ed566011245 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-841147689" status: 202 len: 0 microversion: 2.1 time: 0.026675 Oct 28 08:50:31.535511 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 661/1335] 10.222.0.76 () {58 vars in 1217 bytes} [Thu Oct 28 08:50:31 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-841147689 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:50:32.324120 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4dcbdbf8-bf42-4224-b456-1413ead45771 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:32.324789 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4dcbdbf8-bf42-4224-b456-1413ead45771 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:32.328710 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-9ed1d387-ed04-497d-b862-c167bd2e54f4 req-2872dc39-8dcd-4bb7-ab16-2095e29b90ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de3329c3-6608-4f3d-a14e-a1c563567ca1", "tag": "0740398f-07ce-4e13-b20f-5cf387cc8ba7"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:32.330241 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:50:32.330241 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:50:32.333123 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dcbdbf8-bf42-4224-b456-1413ead45771 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:32.333728 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dcbdbf8-bf42-4224-b456-1413ead45771 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:32.334982 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dcbdbf8-bf42-4224-b456-1413ead45771 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:32.335495 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dcbdbf8-bf42-4224-b456-1413ead45771 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:32.348409 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9ed1d387-ed04-497d-b862-c167bd2e54f4 req-2872dc39-8dcd-4bb7-ab16-2095e29b90ad service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:32.348930 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9ed1d387-ed04-497d-b862-c167bd2e54f4 req-2872dc39-8dcd-4bb7-ab16-2095e29b90ad service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:32.364813 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4dcbdbf8-bf42-4224-b456-1413ead45771 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:50:32.374991 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-9ed1d387-ed04-497d-b862-c167bd2e54f4 req-2872dc39-8dcd-4bb7-ab16-2095e29b90ad service nova] Creating event network-changed:0740398f-07ce-4e13-b20f-5cf387cc8ba7 for instance de3329c3-6608-4f3d-a14e-a1c563567ca1 on hv-cinder-81565 Oct 28 08:50:32.381364 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-9ed1d387-ed04-497d-b862-c167bd2e54f4 req-2872dc39-8dcd-4bb7-ab16-2095e29b90ad service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058223 Oct 28 08:50:32.382564 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 662/1336] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:50:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:50:32.533805 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4dcbdbf8-bf42-4224-b456-1413ead45771 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "DELETE /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 204 len: 0 microversion: 2.1 time: 0.214891 Oct 28 08:50:32.534708 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 675/1337] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Oct 28 08:50:32 2021] DELETE /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:50:32.543981 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-45db41c2-ff59-4183-9ab2-82d717ac9c97 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:32.544767 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-45db41c2-ff59-4183-9ab2-82d717ac9c97 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:32.557250 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45db41c2-ff59-4183-9ab2-82d717ac9c97 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:32.558050 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45db41c2-ff59-4183-9ab2-82d717ac9c97 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:32.559074 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45db41c2-ff59-4183-9ab2-82d717ac9c97 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:32.559711 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45db41c2-ff59-4183-9ab2-82d717ac9c97 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:32.817337 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-45db41c2-ff59-4183-9ab2-82d717ac9c97 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:32.827526 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-45db41c2-ff59-4183-9ab2-82d717ac9c97 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1569 microversion: 2.1 time: 0.286872 Oct 28 08:50:32.827954 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 663/1338] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:32 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1569 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:33.846277 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bcbd315d-9e3d-4832-a804-939117016d85 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:33.847201 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bcbd315d-9e3d-4832-a804-939117016d85 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:33.853877 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcbd315d-9e3d-4832-a804-939117016d85 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:33.854326 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcbd315d-9e3d-4832-a804-939117016d85 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:33.855128 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcbd315d-9e3d-4832-a804-939117016d85 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:33.855554 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcbd315d-9e3d-4832-a804-939117016d85 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:33.993712 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-bcbd315d-9e3d-4832-a804-939117016d85 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:34.002377 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bcbd315d-9e3d-4832-a804-939117016d85 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1451 microversion: 2.1 time: 0.160507 Oct 28 08:50:34.003043 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 676/1339] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:33 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:34.846380 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-90ce8e63-f9aa-4686-964f-a26ba5ad13d5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:34.847077 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-90ce8e63-f9aa-4686-964f-a26ba5ad13d5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:34.855537 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90ce8e63-f9aa-4686-964f-a26ba5ad13d5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:34.856065 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90ce8e63-f9aa-4686-964f-a26ba5ad13d5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:34.856649 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90ce8e63-f9aa-4686-964f-a26ba5ad13d5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:34.857295 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90ce8e63-f9aa-4686-964f-a26ba5ad13d5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:34.874724 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-90ce8e63-f9aa-4686-964f-a26ba5ad13d5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] HTTP exception thrown: Instance e7b330ee-3ee9-48ec-bd24-81e216ae78ae could not be found. Oct 28 08:50:34.875839 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-90ce8e63-f9aa-4686-964f-a26ba5ad13d5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Returning 404 to user: Instance e7b330ee-3ee9-48ec-bd24-81e216ae78ae could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:50:34.876664 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-90ce8e63-f9aa-4686-964f-a26ba5ad13d5 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae" status: 404 len: 111 microversion: 2.1 time: 0.034220 Oct 28 08:50:34.877442 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 664/1340] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Oct 28 08:50:34 2021] DELETE /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:50:34.886243 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-384e61ed-5645-4b4d-9692-9c9ac6940784 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:34.886926 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-384e61ed-5645-4b4d-9692-9c9ac6940784 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: e7b330ee-3ee9-48ec-bd24-81e216ae78ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:34.894329 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-384e61ed-5645-4b4d-9692-9c9ac6940784 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:34.894791 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-384e61ed-5645-4b4d-9692-9c9ac6940784 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:34.895623 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-384e61ed-5645-4b4d-9692-9c9ac6940784 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:34.896073 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-384e61ed-5645-4b4d-9692-9c9ac6940784 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:34.913065 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-384e61ed-5645-4b4d-9692-9c9ac6940784 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] HTTP exception thrown: Instance e7b330ee-3ee9-48ec-bd24-81e216ae78ae could not be found. Oct 28 08:50:34.913691 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-384e61ed-5645-4b4d-9692-9c9ac6940784 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Returning 404 to user: Instance e7b330ee-3ee9-48ec-bd24-81e216ae78ae could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:50:34.914567 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-384e61ed-5645-4b4d-9692-9c9ac6940784 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae" status: 404 len: 111 microversion: 2.1 time: 0.032777 Oct 28 08:50:34.915152 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 677/1341] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:34 2021] GET /compute/v2.1/servers/e7b330ee-3ee9-48ec-bd24-81e216ae78ae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 08:50:34.943788 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-0f78ef1e-3ef4-4aad-be78-9c165c0970cb req-55e0a572-5dc9-4208-8a92-7e3c9a2dfea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de3329c3-6608-4f3d-a14e-a1c563567ca1", "name": "network-vif-deleted", "tag": "0740398f-07ce-4e13-b20f-5cf387cc8ba7"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:50:34.946738 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:50:34.946738 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:50:34.955302 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0f78ef1e-3ef4-4aad-be78-9c165c0970cb req-55e0a572-5dc9-4208-8a92-7e3c9a2dfea2 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:34.955672 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0f78ef1e-3ef4-4aad-be78-9c165c0970cb req-55e0a572-5dc9-4208-8a92-7e3c9a2dfea2 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:34.972886 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-0f78ef1e-3ef4-4aad-be78-9c165c0970cb req-55e0a572-5dc9-4208-8a92-7e3c9a2dfea2 service nova] Creating event network-vif-deleted:0740398f-07ce-4e13-b20f-5cf387cc8ba7 for instance de3329c3-6608-4f3d-a14e-a1c563567ca1 on hv-cinder-81565 Oct 28 08:50:34.981327 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-0f78ef1e-3ef4-4aad-be78-9c165c0970cb req-55e0a572-5dc9-4208-8a92-7e3c9a2dfea2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038768 Oct 28 08:50:34.985418 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 665/1342] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:50:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:50:35.020620 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-959495b7-4232-45ef-9b23-d525930b6bdb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:35.021226 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-959495b7-4232-45ef-9b23-d525930b6bdb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:35.028371 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-959495b7-4232-45ef-9b23-d525930b6bdb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:35.028823 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-959495b7-4232-45ef-9b23-d525930b6bdb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:35.029667 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-959495b7-4232-45ef-9b23-d525930b6bdb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:35.030283 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-959495b7-4232-45ef-9b23-d525930b6bdb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:35.098637 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-959495b7-4232-45ef-9b23-d525930b6bdb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f262d208d53949b8a1836c8aa4fc3376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5a1400e6c8401a9ac7192333826fde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:50:35.106563 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-959495b7-4232-45ef-9b23-d525930b6bdb tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 200 len: 1219 microversion: 2.1 time: 0.090091 Oct 28 08:50:35.107136 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 678/1343] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:35 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:50:36.062305 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3c762dc9-9d23-47b0-b836-35875eb0fefb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:36.063021 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3c762dc9-9d23-47b0-b836-35875eb0fefb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:36.071604 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c762dc9-9d23-47b0-b836-35875eb0fefb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:36.072048 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c762dc9-9d23-47b0-b836-35875eb0fefb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:36.072820 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c762dc9-9d23-47b0-b836-35875eb0fefb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:36.073243 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c762dc9-9d23-47b0-b836-35875eb0fefb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:36.088594 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-3c762dc9-9d23-47b0-b836-35875eb0fefb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] HTTP exception thrown: Instance 914cd123-e872-418a-bf38-f477fe1551b3 could not be found. Oct 28 08:50:36.089183 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3c762dc9-9d23-47b0-b836-35875eb0fefb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Returning 404 to user: Instance 914cd123-e872-418a-bf38-f477fe1551b3 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:50:36.090010 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3c762dc9-9d23-47b0-b836-35875eb0fefb tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "DELETE /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 404 len: 111 microversion: 2.1 time: 0.033669 Oct 28 08:50:36.090594 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 666/1344] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Oct 28 08:50:36 2021] DELETE /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:50:36.099215 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-00fbf76f-c11e-40bc-9188-fd1c1ad5b3b2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:36.099828 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-00fbf76f-c11e-40bc-9188-fd1c1ad5b3b2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] [instance: 914cd123-e872-418a-bf38-f477fe1551b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:36.106394 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00fbf76f-c11e-40bc-9188-fd1c1ad5b3b2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:36.106872 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00fbf76f-c11e-40bc-9188-fd1c1ad5b3b2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:36.108034 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00fbf76f-c11e-40bc-9188-fd1c1ad5b3b2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:36.108525 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00fbf76f-c11e-40bc-9188-fd1c1ad5b3b2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:36.122841 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-00fbf76f-c11e-40bc-9188-fd1c1ad5b3b2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] HTTP exception thrown: Instance 914cd123-e872-418a-bf38-f477fe1551b3 could not be found. Oct 28 08:50:36.124422 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-00fbf76f-c11e-40bc-9188-fd1c1ad5b3b2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] Returning 404 to user: Instance 914cd123-e872-418a-bf38-f477fe1551b3 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:50:36.124852 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a6add14e-428d-4fe4-8134-55644f169a62 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:36.125410 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-00fbf76f-c11e-40bc-9188-fd1c1ad5b3b2 tempest-AttachVolumeTestJSON-625284733 tempest-AttachVolumeTestJSON-625284733-project] 10.222.0.76 "GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3" status: 404 len: 111 microversion: 2.1 time: 0.030024 Oct 28 08:50:36.125645 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a6add14e-428d-4fe4-8134-55644f169a62 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] [instance: de3329c3-6608-4f3d-a14e-a1c563567ca1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:50:36.126001 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 679/1345] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:36 2021] GET /compute/v2.1/servers/914cd123-e872-418a-bf38-f477fe1551b3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:50:36.132143 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6add14e-428d-4fe4-8134-55644f169a62 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:36.132587 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6add14e-428d-4fe4-8134-55644f169a62 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:36.133365 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6add14e-428d-4fe4-8134-55644f169a62 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:50:36.133802 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6add14e-428d-4fe4-8134-55644f169a62 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:50:36.149947 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-a6add14e-428d-4fe4-8134-55644f169a62 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] HTTP exception thrown: Instance de3329c3-6608-4f3d-a14e-a1c563567ca1 could not be found. Oct 28 08:50:36.150566 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a6add14e-428d-4fe4-8134-55644f169a62 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Returning 404 to user: Instance de3329c3-6608-4f3d-a14e-a1c563567ca1 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:50:36.151410 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a6add14e-428d-4fe4-8134-55644f169a62 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1" status: 404 len: 111 microversion: 2.1 time: 0.031207 Oct 28 08:50:36.152188 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 667/1346] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:50:36 2021] GET /compute/v2.1/servers/de3329c3-6608-4f3d-a14e-a1c563567ca1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 08:50:36.336036 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-97f5a3f4-8c10-4cbd-84c5-70326039ebb3 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] Calling method '.version_select at 0x7fed6f2c6160>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:50:36.363444 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-97f5a3f4-8c10-4cbd-84c5-70326039ebb3 tempest-TestShelveInstance-1721406179 tempest-TestShelveInstance-1721406179-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-859765321" status: 202 len: 0 microversion: 2.1 time: 0.030975 Oct 28 08:50:36.364491 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 680/1347] 10.222.0.76 () {58 vars in 1250 bytes} [Thu Oct 28 08:50:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-859765321 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:51:06.962466 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-13e4dd88-33c1-4132-958e-6ef4e3505c1d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:06.963400 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-13e4dd88-33c1-4132-958e-6ef4e3505c1d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:06.969604 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-13e4dd88-33c1-4132-958e-6ef4e3505c1d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:06.970049 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-13e4dd88-33c1-4132-958e-6ef4e3505c1d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:06.970850 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-13e4dd88-33c1-4132-958e-6ef4e3505c1d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:06.971286 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-13e4dd88-33c1-4132-958e-6ef4e3505c1d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:07.003200 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-13e4dd88-33c1-4132-958e-6ef4e3505c1d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044671 Oct 28 08:51:07.003754 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 668/1348] 10.222.0.76 () {60 vars in 1342 bytes} [Thu Oct 28 08:51:06 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:07.062207 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-57cbcf1a-c6b8-431c-abc7-3171215eaaec tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:07.062783 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-57cbcf1a-c6b8-431c-abc7-3171215eaaec tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:07.068657 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57cbcf1a-c6b8-431c-abc7-3171215eaaec tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:07.069100 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57cbcf1a-c6b8-431c-abc7-3171215eaaec tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:07.069861 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57cbcf1a-c6b8-431c-abc7-3171215eaaec tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:07.070289 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57cbcf1a-c6b8-431c-abc7-3171215eaaec tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:07.098843 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-57cbcf1a-c6b8-431c-abc7-3171215eaaec tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:51:07.181376 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-57cbcf1a-c6b8-431c-abc7-3171215eaaec tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "DELETE /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 204 len: 0 microversion: 2.20 time: 0.123657 Oct 28 08:51:07.181946 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 681/1349] 10.222.0.76 () {60 vars in 1279 bytes} [Thu Oct 28 08:51:07 2021] DELETE /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 08:51:07.190449 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f4e4e9f3-095c-4c23-9014-193a55988a10 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:07.191079 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f4e4e9f3-095c-4c23-9014-193a55988a10 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:07.196937 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4e4e9f3-095c-4c23-9014-193a55988a10 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:07.197373 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4e4e9f3-095c-4c23-9014-193a55988a10 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:07.198294 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4e4e9f3-095c-4c23-9014-193a55988a10 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:07.198744 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4e4e9f3-095c-4c23-9014-193a55988a10 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:07.324218 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-f4e4e9f3-095c-4c23-9014-193a55988a10 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:07.333362 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-f4e4e9f3-095c-4c23-9014-193a55988a10 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:07.335011 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-f4e4e9f3-095c-4c23-9014-193a55988a10 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:07.336554 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f4e4e9f3-095c-4c23-9014-193a55988a10 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1723 microversion: 2.20 time: 0.149760 Oct 28 08:51:07.337164 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 669/1350] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:07 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:08.355287 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bc059fb5-30be-41a7-b5e7-aaa07f259a9a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:08.356872 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bc059fb5-30be-41a7-b5e7-aaa07f259a9a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:08.363685 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc059fb5-30be-41a7-b5e7-aaa07f259a9a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:08.364504 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc059fb5-30be-41a7-b5e7-aaa07f259a9a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:08.364973 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc059fb5-30be-41a7-b5e7-aaa07f259a9a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:08.365400 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc059fb5-30be-41a7-b5e7-aaa07f259a9a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:08.589499 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-bc059fb5-30be-41a7-b5e7-aaa07f259a9a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:08.613239 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-bc059fb5-30be-41a7-b5e7-aaa07f259a9a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:08.614726 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-bc059fb5-30be-41a7-b5e7-aaa07f259a9a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:08.616110 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bc059fb5-30be-41a7-b5e7-aaa07f259a9a tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1723 microversion: 2.20 time: 0.264869 Oct 28 08:51:08.616854 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 682/1351] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:08 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:09.641681 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-290f7a9e-a117-4c16-9661-2b78960d6fa1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:09.644285 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-290f7a9e-a117-4c16-9661-2b78960d6fa1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:09.659436 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-290f7a9e-a117-4c16-9661-2b78960d6fa1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:09.659771 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-290f7a9e-a117-4c16-9661-2b78960d6fa1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:09.661141 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-290f7a9e-a117-4c16-9661-2b78960d6fa1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:09.661857 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-290f7a9e-a117-4c16-9661-2b78960d6fa1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:09.780020 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-290f7a9e-a117-4c16-9661-2b78960d6fa1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:09.795398 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-290f7a9e-a117-4c16-9661-2b78960d6fa1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:09.798469 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-290f7a9e-a117-4c16-9661-2b78960d6fa1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a8c3c685aa49499037c493b1b99eed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caed8624c42e4e4aab79cb3ca12ef824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:09.800725 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-290f7a9e-a117-4c16-9661-2b78960d6fa1 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 200 len: 1656 microversion: 2.20 time: 0.167812 Oct 28 08:51:09.802061 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 670/1352] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:09 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 1656 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 08:51:10.133371 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-2d925d9d-4053-4da6-aeac-3c3b9f8ae02a req-a18f09d2-cf63-40bd-afaf-e8a3c6707d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd087a0-4efb-4b0c-83f8-dc9577976ee7", "name": "network-vif-deleted", "tag": "bd4afab1-47c9-4cd2-87f5-5d7b28f4e628"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:51:10.136076 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:51:10.136076 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:51:10.149679 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2d925d9d-4053-4da6-aeac-3c3b9f8ae02a req-a18f09d2-cf63-40bd-afaf-e8a3c6707d42 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:10.150369 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2d925d9d-4053-4da6-aeac-3c3b9f8ae02a req-a18f09d2-cf63-40bd-afaf-e8a3c6707d42 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:10.176922 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-2d925d9d-4053-4da6-aeac-3c3b9f8ae02a req-a18f09d2-cf63-40bd-afaf-e8a3c6707d42 service nova] Creating event network-vif-deleted:bd4afab1-47c9-4cd2-87f5-5d7b28f4e628 for instance acd087a0-4efb-4b0c-83f8-dc9577976ee7 on hv-cinder-81565 Oct 28 08:51:10.186721 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-2d925d9d-4053-4da6-aeac-3c3b9f8ae02a req-a18f09d2-cf63-40bd-afaf-e8a3c6707d42 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059148 Oct 28 08:51:10.202830 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 683/1353] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:51:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:51:10.829062 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-27d5f5af-3a06-41fd-9ead-f69cca3174f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:10.830271 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-27d5f5af-3a06-41fd-9ead-f69cca3174f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:10.837534 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27d5f5af-3a06-41fd-9ead-f69cca3174f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:10.838261 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27d5f5af-3a06-41fd-9ead-f69cca3174f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:10.839291 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27d5f5af-3a06-41fd-9ead-f69cca3174f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:10.839886 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27d5f5af-3a06-41fd-9ead-f69cca3174f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:10.854951 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-27d5f5af-3a06-41fd-9ead-f69cca3174f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] HTTP exception thrown: Instance acd087a0-4efb-4b0c-83f8-dc9577976ee7 could not be found. Oct 28 08:51:10.855547 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-27d5f5af-3a06-41fd-9ead-f69cca3174f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Returning 404 to user: Instance acd087a0-4efb-4b0c-83f8-dc9577976ee7 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:51:10.856643 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-27d5f5af-3a06-41fd-9ead-f69cca3174f2 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 404 len: 111 microversion: 2.20 time: 0.032063 Oct 28 08:51:10.857850 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 671/1354] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Oct 28 08:51:10 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 08:51:10.874108 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-00b474b5-18c2-4e32-85c8-815d5d18d77d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '.version_select at 0x7fed6f2c6670>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:10.896210 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-00b474b5-18c2-4e32-85c8-815d5d18d77d tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1136516755" status: 204 len: 0 microversion: 2.20 time: 0.026331 Oct 28 08:51:10.896786 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 684/1355] 10.222.0.76 () {60 vars in 1261 bytes} [Thu Oct 28 08:51:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1136516755 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 08:51:12.829824 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4dfbabff-c1cf-4b82-bc16-ac932d34c386 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:12.830376 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4dfbabff-c1cf-4b82-bc16-ac932d34c386 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:12.836861 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4dfbabff-c1cf-4b82-bc16-ac932d34c386 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:12.837308 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4dfbabff-c1cf-4b82-bc16-ac932d34c386 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:12.838069 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4dfbabff-c1cf-4b82-bc16-ac932d34c386 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:12.838518 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4dfbabff-c1cf-4b82-bc16-ac932d34c386 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:12.851726 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-4dfbabff-c1cf-4b82-bc16-ac932d34c386 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] HTTP exception thrown: Instance acd087a0-4efb-4b0c-83f8-dc9577976ee7 could not be found. Oct 28 08:51:12.852304 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4dfbabff-c1cf-4b82-bc16-ac932d34c386 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Returning 404 to user: Instance acd087a0-4efb-4b0c-83f8-dc9577976ee7 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:51:12.853170 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4dfbabff-c1cf-4b82-bc16-ac932d34c386 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "DELETE /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 404 len: 111 microversion: 2.1 time: 0.027001 Oct 28 08:51:12.853685 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 672/1356] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Oct 28 08:51:12 2021] DELETE /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:51:12.861567 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-54dfca31-3100-4af5-8769-ceace992af5f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:12.862318 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-54dfca31-3100-4af5-8769-ceace992af5f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: acd087a0-4efb-4b0c-83f8-dc9577976ee7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:12.869492 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54dfca31-3100-4af5-8769-ceace992af5f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:12.869928 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54dfca31-3100-4af5-8769-ceace992af5f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:12.870731 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54dfca31-3100-4af5-8769-ceace992af5f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:12.871154 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54dfca31-3100-4af5-8769-ceace992af5f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:12.885225 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-54dfca31-3100-4af5-8769-ceace992af5f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] HTTP exception thrown: Instance acd087a0-4efb-4b0c-83f8-dc9577976ee7 could not be found. Oct 28 08:51:12.885802 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-54dfca31-3100-4af5-8769-ceace992af5f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Returning 404 to user: Instance acd087a0-4efb-4b0c-83f8-dc9577976ee7 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:51:12.886646 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-54dfca31-3100-4af5-8769-ceace992af5f tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7" status: 404 len: 111 microversion: 2.1 time: 0.028813 Oct 28 08:51:12.887203 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 685/1357] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:12 2021] GET /compute/v2.1/servers/acd087a0-4efb-4b0c-83f8-dc9577976ee7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:51:14.018171 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f3ed9989-daff-4143-ac5b-fb647ad210b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:14.018784 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f3ed9989-daff-4143-ac5b-fb647ad210b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:14.025569 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3ed9989-daff-4143-ac5b-fb647ad210b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:14.026034 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3ed9989-daff-4143-ac5b-fb647ad210b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:14.026823 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3ed9989-daff-4143-ac5b-fb647ad210b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:14.027315 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3ed9989-daff-4143-ac5b-fb647ad210b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:14.043827 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-f3ed9989-daff-4143-ac5b-fb647ad210b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] HTTP exception thrown: Instance 4e3ca69d-4e09-4205-b6ec-2a6189724e46 could not be found. Oct 28 08:51:14.044396 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f3ed9989-daff-4143-ac5b-fb647ad210b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Returning 404 to user: Instance 4e3ca69d-4e09-4205-b6ec-2a6189724e46 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:51:14.045360 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f3ed9989-daff-4143-ac5b-fb647ad210b5 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "DELETE /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 404 len: 111 microversion: 2.1 time: 0.031087 Oct 28 08:51:14.046178 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 673/1358] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Oct 28 08:51:14 2021] DELETE /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:51:14.054223 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-89864d11-8759-44a3-8593-33b8e1a153c6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:14.055018 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-89864d11-8759-44a3-8593-33b8e1a153c6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] [instance: 4e3ca69d-4e09-4205-b6ec-2a6189724e46] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:14.062408 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89864d11-8759-44a3-8593-33b8e1a153c6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:14.062915 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89864d11-8759-44a3-8593-33b8e1a153c6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:14.063822 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89864d11-8759-44a3-8593-33b8e1a153c6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:14.064341 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89864d11-8759-44a3-8593-33b8e1a153c6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:14.081106 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-89864d11-8759-44a3-8593-33b8e1a153c6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] HTTP exception thrown: Instance 4e3ca69d-4e09-4205-b6ec-2a6189724e46 could not be found. Oct 28 08:51:14.081630 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-89864d11-8759-44a3-8593-33b8e1a153c6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] Returning 404 to user: Instance 4e3ca69d-4e09-4205-b6ec-2a6189724e46 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:51:14.082480 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-89864d11-8759-44a3-8593-33b8e1a153c6 tempest-AttachVolumeShelveTestJSON-1475739309 tempest-AttachVolumeShelveTestJSON-1475739309-project] 10.222.0.76 "GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46" status: 404 len: 111 microversion: 2.1 time: 0.032453 Oct 28 08:51:14.083077 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 686/1359] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:14 2021] GET /compute/v2.1/servers/4e3ca69d-4e09-4205-b6ec-2a6189724e46 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:51:20.742000 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e680addd-5af9-48ab-9875-f970f056fef9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1872632343", "imageRef": "339e99be-6a19-4324-aa16-6b690c25dede", "flavorRef": "452", "networks": [{"uuid": "d1e85954-aa8d-4e2c-bf05-e2af5e402c65"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:51:20.806673 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-e680addd-5af9-48ab-9875-f970f056fef9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] validate_networks() for [('d1e85954-aa8d-4e2c-bf05-e2af5e402c65', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:51:21.434626 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e680addd-5af9-48ab-9875-f970f056fef9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:51:21.435049 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e680addd-5af9-48ab-9875-f970f056fef9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:51:21.435556 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e680addd-5af9-48ab-9875-f970f056fef9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:51:21.435962 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e680addd-5af9-48ab-9875-f970f056fef9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:51:21.436371 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e680addd-5af9-48ab-9875-f970f056fef9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:51:21.445591 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e680addd-5af9-48ab-9875-f970f056fef9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:21.446032 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e680addd-5af9-48ab-9875-f970f056fef9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:21.446872 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e680addd-5af9-48ab-9875-f970f056fef9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:21.447300 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e680addd-5af9-48ab-9875-f970f056fef9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:21.472270 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-e680addd-5af9-48ab-9875-f970f056fef9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Getting quotas for project 44c9c1891789491bbcae9bca7f8654f2. Resources: {'instances', 'cores', 'ram'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:51:21.476532 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-e680addd-5af9-48ab-9875-f970f056fef9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Getting quotas for user 1ca3422951ef4ccc8f40838ba2532bbf and project 44c9c1891789491bbcae9bca7f8654f2. Resources: {'instances', 'cores', 'ram'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:51:21.487666 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e680addd-5af9-48ab-9875-f970f056fef9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:51:21.490033 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e680addd-5af9-48ab-9875-f970f056fef9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: 2f51bb90-b4e0-485a-9db4-898212fc5867] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='339e99be-6a19-4324-aa16-6b690c25dede',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:51:21.539159 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e680addd-5af9-48ab-9875-f970f056fef9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.800958 Oct 28 08:51:21.539806 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 674/1360] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Oct 28 08:51:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:51:21.550388 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d9aa5f68-69c8-4d12-82af-7499418a99a8 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:21.551140 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d9aa5f68-69c8-4d12-82af-7499418a99a8 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: 2f51bb90-b4e0-485a-9db4-898212fc5867] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:21.605482 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-d9aa5f68-69c8-4d12-82af-7499418a99a8 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:21.612341 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d9aa5f68-69c8-4d12-82af-7499418a99a8 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867" status: 200 len: 1219 microversion: 2.1 time: 0.065598 Oct 28 08:51:21.612849 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 687/1361] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:21 2021] GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:22.635006 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2da6c11b-83c2-4be7-bb87-8a6d43255199 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:22.635580 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2da6c11b-83c2-4be7-bb87-8a6d43255199 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: 2f51bb90-b4e0-485a-9db4-898212fc5867] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:22.693033 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-2da6c11b-83c2-4be7-bb87-8a6d43255199 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:22.701261 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2da6c11b-83c2-4be7-bb87-8a6d43255199 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867" status: 200 len: 1219 microversion: 2.1 time: 0.070448 Oct 28 08:51:22.701821 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 675/1362] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:22 2021] GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:23.719402 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-04069ece-d162-48d9-b515-0f395ac6f9bc tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:23.720000 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-04069ece-d162-48d9-b515-0f395ac6f9bc tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: 2f51bb90-b4e0-485a-9db4-898212fc5867] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:23.773909 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-04069ece-d162-48d9-b515-0f395ac6f9bc tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:23.781651 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-04069ece-d162-48d9-b515-0f395ac6f9bc tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867" status: 200 len: 1219 microversion: 2.1 time: 0.066630 Oct 28 08:51:23.782202 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 688/1363] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:23 2021] GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:24.799354 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-624ac6d5-74e3-4723-9bb7-4ec1bc090d3d tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:24.799955 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-624ac6d5-74e3-4723-9bb7-4ec1bc090d3d tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: 2f51bb90-b4e0-485a-9db4-898212fc5867] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:24.855459 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-624ac6d5-74e3-4723-9bb7-4ec1bc090d3d tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:24.863479 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-624ac6d5-74e3-4723-9bb7-4ec1bc090d3d tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867" status: 200 len: 1219 microversion: 2.1 time: 0.067887 Oct 28 08:51:24.864259 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 676/1364] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:24 2021] GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:25.881123 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-55b7acad-2b79-448c-9ee5-725d9be70ac0 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:25.881754 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-55b7acad-2b79-448c-9ee5-725d9be70ac0 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: 2f51bb90-b4e0-485a-9db4-898212fc5867] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:25.890844 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55b7acad-2b79-448c-9ee5-725d9be70ac0 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:25.891430 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55b7acad-2b79-448c-9ee5-725d9be70ac0 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:25.892268 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55b7acad-2b79-448c-9ee5-725d9be70ac0 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:25.892704 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55b7acad-2b79-448c-9ee5-725d9be70ac0 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:25.960256 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-55b7acad-2b79-448c-9ee5-725d9be70ac0 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:25.968671 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-55b7acad-2b79-448c-9ee5-725d9be70ac0 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867" status: 200 len: 1223 microversion: 2.1 time: 0.091241 Oct 28 08:51:25.969244 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 689/1365] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:25 2021] GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:26.986222 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-be904bac-bd48-49bc-b6ad-61a55c42d18f tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:26.986912 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-be904bac-bd48-49bc-b6ad-61a55c42d18f tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: 2f51bb90-b4e0-485a-9db4-898212fc5867] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:26.996273 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be904bac-bd48-49bc-b6ad-61a55c42d18f tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:26.996727 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be904bac-bd48-49bc-b6ad-61a55c42d18f tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:26.997699 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be904bac-bd48-49bc-b6ad-61a55c42d18f tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:26.998143 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be904bac-bd48-49bc-b6ad-61a55c42d18f tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:27.058104 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-be904bac-bd48-49bc-b6ad-61a55c42d18f tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:27.065473 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-be904bac-bd48-49bc-b6ad-61a55c42d18f tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867" status: 200 len: 1215 microversion: 2.1 time: 0.083000 Oct 28 08:51:27.066034 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 677/1366] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:26 2021] GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867 => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:28.082642 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5d2bd8fa-1e90-4614-993b-20bfa1f191ac tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:28.083340 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5d2bd8fa-1e90-4614-993b-20bfa1f191ac tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: 2f51bb90-b4e0-485a-9db4-898212fc5867] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:28.089826 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d2bd8fa-1e90-4614-993b-20bfa1f191ac tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:28.090292 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d2bd8fa-1e90-4614-993b-20bfa1f191ac tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:28.092341 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d2bd8fa-1e90-4614-993b-20bfa1f191ac tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:28.092767 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d2bd8fa-1e90-4614-993b-20bfa1f191ac tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:28.155725 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-5d2bd8fa-1e90-4614-993b-20bfa1f191ac tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:28.163690 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5d2bd8fa-1e90-4614-993b-20bfa1f191ac tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867" status: 200 len: 1215 microversion: 2.1 time: 0.084852 Oct 28 08:51:28.164274 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 690/1367] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:28 2021] GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867 => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:29.181232 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0ab0be7f-287f-4e23-8cfa-cc7a621b4ac9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:29.181829 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0ab0be7f-287f-4e23-8cfa-cc7a621b4ac9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: 2f51bb90-b4e0-485a-9db4-898212fc5867] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:29.188399 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ab0be7f-287f-4e23-8cfa-cc7a621b4ac9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:29.188845 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ab0be7f-287f-4e23-8cfa-cc7a621b4ac9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:29.189612 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ab0be7f-287f-4e23-8cfa-cc7a621b4ac9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:29.190040 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ab0be7f-287f-4e23-8cfa-cc7a621b4ac9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:29.250232 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-0ab0be7f-287f-4e23-8cfa-cc7a621b4ac9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:29.257866 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0ab0be7f-287f-4e23-8cfa-cc7a621b4ac9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867" status: 200 len: 1215 microversion: 2.1 time: 0.080224 Oct 28 08:51:29.258436 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 678/1368] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:29 2021] GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867 => generated 1215 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:30.278824 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f47dcc78-d7a7-4f67-8c8d-c2f3adca7d15 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:30.280147 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f47dcc78-d7a7-4f67-8c8d-c2f3adca7d15 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: 2f51bb90-b4e0-485a-9db4-898212fc5867] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:30.290592 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f47dcc78-d7a7-4f67-8c8d-c2f3adca7d15 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:30.291266 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f47dcc78-d7a7-4f67-8c8d-c2f3adca7d15 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:30.292069 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f47dcc78-d7a7-4f67-8c8d-c2f3adca7d15 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:30.292507 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f47dcc78-d7a7-4f67-8c8d-c2f3adca7d15 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:30.397593 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-f47dcc78-d7a7-4f67-8c8d-c2f3adca7d15 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:30.405936 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f47dcc78-d7a7-4f67-8c8d-c2f3adca7d15 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867" status: 200 len: 1277 microversion: 2.1 time: 0.133712 Oct 28 08:51:30.407268 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 691/1369] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:30 2021] GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867 => generated 1277 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:31.424286 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6b7450bd-e76f-44fa-a9a0-a5ae8afbca09 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:31.424959 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6b7450bd-e76f-44fa-a9a0-a5ae8afbca09 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: 2f51bb90-b4e0-485a-9db4-898212fc5867] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:31.431699 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b7450bd-e76f-44fa-a9a0-a5ae8afbca09 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:31.432189 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b7450bd-e76f-44fa-a9a0-a5ae8afbca09 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:31.433063 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b7450bd-e76f-44fa-a9a0-a5ae8afbca09 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:31.433488 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b7450bd-e76f-44fa-a9a0-a5ae8afbca09 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:31.573795 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-6b7450bd-e76f-44fa-a9a0-a5ae8afbca09 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:31.584925 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6b7450bd-e76f-44fa-a9a0-a5ae8afbca09 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867" status: 200 len: 1319 microversion: 2.1 time: 0.164809 Oct 28 08:51:31.585653 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 679/1370] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:31 2021] GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:31.664353 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-105dfc83-3c35-4ee3-bd30-eaa76691f514 req-f55210f2-5166-4832-a5bd-79a8fe0b42e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f51bb90-b4e0-485a-9db4-898212fc5867", "tag": "4f65f654-4e7d-486a-97f4-1d691a0b976b"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:51:31.666698 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:51:31.666698 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:51:31.682195 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-105dfc83-3c35-4ee3-bd30-eaa76691f514 req-f55210f2-5166-4832-a5bd-79a8fe0b42e7 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:31.682850 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-105dfc83-3c35-4ee3-bd30-eaa76691f514 req-f55210f2-5166-4832-a5bd-79a8fe0b42e7 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:31.703657 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-105dfc83-3c35-4ee3-bd30-eaa76691f514 req-f55210f2-5166-4832-a5bd-79a8fe0b42e7 service nova] Creating event network-changed:4f65f654-4e7d-486a-97f4-1d691a0b976b for instance 2f51bb90-b4e0-485a-9db4-898212fc5867 on hv-cinder-81565 Oct 28 08:51:31.712542 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-105dfc83-3c35-4ee3-bd30-eaa76691f514 req-f55210f2-5166-4832-a5bd-79a8fe0b42e7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052860 Oct 28 08:51:31.713587 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 692/1371] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:51:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:51:32.607892 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-af4950b3-0868-4fcf-b3b9-5ed7440d1059 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:32.608792 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-af4950b3-0868-4fcf-b3b9-5ed7440d1059 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: 2f51bb90-b4e0-485a-9db4-898212fc5867] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:32.619690 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af4950b3-0868-4fcf-b3b9-5ed7440d1059 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:32.620479 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af4950b3-0868-4fcf-b3b9-5ed7440d1059 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:32.622391 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af4950b3-0868-4fcf-b3b9-5ed7440d1059 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:32.623364 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af4950b3-0868-4fcf-b3b9-5ed7440d1059 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:32.842050 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-af4950b3-0868-4fcf-b3b9-5ed7440d1059 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:32.851523 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-af4950b3-0868-4fcf-b3b9-5ed7440d1059 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867" status: 200 len: 1319 microversion: 2.1 time: 0.248228 Oct 28 08:51:32.852105 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 680/1372] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:32 2021] GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867 => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:33.886827 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-12b8a3d3-f2de-4849-a306-49af25a9f935 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:33.888889 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-12b8a3d3-f2de-4849-a306-49af25a9f935 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: 2f51bb90-b4e0-485a-9db4-898212fc5867] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:33.903113 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12b8a3d3-f2de-4849-a306-49af25a9f935 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:33.903113 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12b8a3d3-f2de-4849-a306-49af25a9f935 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:33.903113 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12b8a3d3-f2de-4849-a306-49af25a9f935 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:33.903113 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12b8a3d3-f2de-4849-a306-49af25a9f935 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:34.076725 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-12b8a3d3-f2de-4849-a306-49af25a9f935 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:34.097729 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-12b8a3d3-f2de-4849-a306-49af25a9f935 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867" status: 200 len: 1319 microversion: 2.1 time: 0.218201 Oct 28 08:51:34.099109 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 693/1373] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:33 2021] GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:34.240195 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 08:51:34.240680 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: Thu Oct 28 08:51:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 08:51:35.124817 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f64fc346-7248-497a-952b-4ade90277b00 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:35.125429 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f64fc346-7248-497a-952b-4ade90277b00 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: 2f51bb90-b4e0-485a-9db4-898212fc5867] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:35.132049 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f64fc346-7248-497a-952b-4ade90277b00 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:35.132489 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f64fc346-7248-497a-952b-4ade90277b00 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:35.133269 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f64fc346-7248-497a-952b-4ade90277b00 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:35.133696 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f64fc346-7248-497a-952b-4ade90277b00 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:35.291658 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-f64fc346-7248-497a-952b-4ade90277b00 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:35.301010 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f64fc346-7248-497a-952b-4ade90277b00 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867" status: 200 len: 1319 microversion: 2.1 time: 0.180321 Oct 28 08:51:35.301703 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 681/1374] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:35 2021] GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:51:36.325114 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-145de5c0-c6f4-4524-9219-e543a8613db2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:36.326798 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-145de5c0-c6f4-4524-9219-e543a8613db2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: 2f51bb90-b4e0-485a-9db4-898212fc5867] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:36.335617 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-145de5c0-c6f4-4524-9219-e543a8613db2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:36.336315 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-145de5c0-c6f4-4524-9219-e543a8613db2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:36.337232 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-145de5c0-c6f4-4524-9219-e543a8613db2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:36.337519 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-145de5c0-c6f4-4524-9219-e543a8613db2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:36.494397 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-145de5c0-c6f4-4524-9219-e543a8613db2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:36.507779 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-145de5c0-c6f4-4524-9219-e543a8613db2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867" status: 200 len: 1319 microversion: 2.1 time: 0.189633 Oct 28 08:51:36.508370 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 694/1375] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:36 2021] GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:37.524978 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d63439ed-7880-41d8-8981-1c6569fc6c67 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:37.525663 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d63439ed-7880-41d8-8981-1c6569fc6c67 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: 2f51bb90-b4e0-485a-9db4-898212fc5867] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:37.533126 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d63439ed-7880-41d8-8981-1c6569fc6c67 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:37.533574 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d63439ed-7880-41d8-8981-1c6569fc6c67 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:37.534363 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d63439ed-7880-41d8-8981-1c6569fc6c67 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:37.534869 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d63439ed-7880-41d8-8981-1c6569fc6c67 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:37.697007 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-d63439ed-7880-41d8-8981-1c6569fc6c67 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:37.706260 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d63439ed-7880-41d8-8981-1c6569fc6c67 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867" status: 200 len: 1319 microversion: 2.1 time: 0.184658 Oct 28 08:51:37.706898 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 682/1376] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:37 2021] GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:38.729626 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8966afb6-9a3d-42df-b1ad-675dae547908 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:38.730281 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8966afb6-9a3d-42df-b1ad-675dae547908 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: 2f51bb90-b4e0-485a-9db4-898212fc5867] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:38.737261 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8966afb6-9a3d-42df-b1ad-675dae547908 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:38.737698 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8966afb6-9a3d-42df-b1ad-675dae547908 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:38.738474 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8966afb6-9a3d-42df-b1ad-675dae547908 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:38.738953 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8966afb6-9a3d-42df-b1ad-675dae547908 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:38.881923 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-8966afb6-9a3d-42df-b1ad-675dae547908 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:38.894246 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8966afb6-9a3d-42df-b1ad-675dae547908 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867" status: 200 len: 1319 microversion: 2.1 time: 0.168014 Oct 28 08:51:38.895181 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 695/1377] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:38 2021] GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:39.258012 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-7c266085-3182-4809-8279-ae6c93173866 req-af02f33f-d2e8-41ac-b936-ff1cb8e3d5ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f51bb90-b4e0-485a-9db4-898212fc5867", "name": "network-vif-plugged", "status": "completed", "tag": "4f65f654-4e7d-486a-97f4-1d691a0b976b"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:51:39.259707 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:51:39.259707 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:51:39.272608 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-7c266085-3182-4809-8279-ae6c93173866 req-af02f33f-d2e8-41ac-b936-ff1cb8e3d5ba service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:39.273470 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-7c266085-3182-4809-8279-ae6c93173866 req-af02f33f-d2e8-41ac-b936-ff1cb8e3d5ba service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:39.290426 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-7c266085-3182-4809-8279-ae6c93173866 req-af02f33f-d2e8-41ac-b936-ff1cb8e3d5ba service nova] Creating event network-vif-plugged:4f65f654-4e7d-486a-97f4-1d691a0b976b for instance 2f51bb90-b4e0-485a-9db4-898212fc5867 on hv-cinder-81565 Oct 28 08:51:39.295018 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-7c266085-3182-4809-8279-ae6c93173866 req-af02f33f-d2e8-41ac-b936-ff1cb8e3d5ba service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180023 Oct 28 08:51:39.295613 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 683/1378] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:51:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:51:39.913109 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3e57000a-45d5-4750-825f-b6fd69981b20 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:39.913735 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3e57000a-45d5-4750-825f-b6fd69981b20 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: 2f51bb90-b4e0-485a-9db4-898212fc5867] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:39.921210 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e57000a-45d5-4750-825f-b6fd69981b20 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:39.921657 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e57000a-45d5-4750-825f-b6fd69981b20 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:39.922435 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e57000a-45d5-4750-825f-b6fd69981b20 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:39.922894 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e57000a-45d5-4750-825f-b6fd69981b20 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:40.053349 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3e57000a-45d5-4750-825f-b6fd69981b20 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:40.060932 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3e57000a-45d5-4750-825f-b6fd69981b20 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867" status: 200 len: 1319 microversion: 2.1 time: 0.151532 Oct 28 08:51:40.061505 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 696/1379] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:39 2021] GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:51:41.077852 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5b5801b6-aa96-40b2-98e3-16f0f61145db tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:51:41.078863 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5b5801b6-aa96-40b2-98e3-16f0f61145db tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: 2f51bb90-b4e0-485a-9db4-898212fc5867] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:51:41.087069 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b5801b6-aa96-40b2-98e3-16f0f61145db tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:41.087515 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b5801b6-aa96-40b2-98e3-16f0f61145db tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:41.088294 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b5801b6-aa96-40b2-98e3-16f0f61145db tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:51:41.089096 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b5801b6-aa96-40b2-98e3-16f0f61145db tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:51:41.235224 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-5b5801b6-aa96-40b2-98e3-16f0f61145db tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:51:41.242912 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5b5801b6-aa96-40b2-98e3-16f0f61145db tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867" status: 200 len: 1508 microversion: 2.1 time: 0.169595 Oct 28 08:51:41.243480 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 684/1380] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:51:41 2021] GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:05.030915 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3feb70d8-9f20-4e26-a92d-dd661146e993 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c330b7e1-adc9-42d0-9713-413bd5e2440f", "device": "/dev/sdb"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:52:05.032576 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3feb70d8-9f20-4e26-a92d-dd661146e993 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: 2f51bb90-b4e0-485a-9db4-898212fc5867] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:05.039287 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3feb70d8-9f20-4e26-a92d-dd661146e993 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:05.039725 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3feb70d8-9f20-4e26-a92d-dd661146e993 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:05.040508 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3feb70d8-9f20-4e26-a92d-dd661146e993 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:05.040929 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3feb70d8-9f20-4e26-a92d-dd661146e993 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:05.318143 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3feb70d8-9f20-4e26-a92d-dd661146e993 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "POST /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291108 Oct 28 08:52:05.318811 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 697/1381] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Oct 28 08:52:05 2021] POST /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:52:05.672472 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1af63471-af96-4611-b4f2-167a3567207f tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1676391139", "imageRef": "339e99be-6a19-4324-aa16-6b690c25dede", "flavorRef": "452"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:52:05.732419 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-1af63471-af96-4611-b4f2-167a3567207f tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] validate_networks() for None {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:52:06.143362 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-1af63471-af96-4611-b4f2-167a3567207f tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:52:06.143773 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-1af63471-af96-4611-b4f2-167a3567207f tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:52:06.144239 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-1af63471-af96-4611-b4f2-167a3567207f tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:52:06.144628 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-1af63471-af96-4611-b4f2-167a3567207f tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:52:06.145037 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-1af63471-af96-4611-b4f2-167a3567207f tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:52:06.156867 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1af63471-af96-4611-b4f2-167a3567207f tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:06.157272 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1af63471-af96-4611-b4f2-167a3567207f tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:06.158066 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1af63471-af96-4611-b4f2-167a3567207f tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:06.158490 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1af63471-af96-4611-b4f2-167a3567207f tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:06.175579 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-1af63471-af96-4611-b4f2-167a3567207f tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Getting quotas for project fca1fcaaa64943c588c2963490ef2fe9. Resources: {'instances', 'cores', 'ram'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:52:06.180099 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-1af63471-af96-4611-b4f2-167a3567207f tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Getting quotas for user 186f031d59c648179182421732afb9ca and project fca1fcaaa64943c588c2963490ef2fe9. Resources: {'instances', 'cores', 'ram'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:52:06.192579 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1af63471-af96-4611-b4f2-167a3567207f tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:52:06.195499 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1af63471-af96-4611-b4f2-167a3567207f tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] [instance: 1359a6b5-e39c-461f-96a3-f7772b7bd441] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='339e99be-6a19-4324-aa16-6b690c25dede',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:52:06.251554 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1af63471-af96-4611-b4f2-167a3567207f tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583565 Oct 28 08:52:06.252442 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 685/1382] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Oct 28 08:52:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:52:06.264345 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1fdf7c8c-d4af-4590-b5a7-1b1ed566d83f tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:06.265151 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1fdf7c8c-d4af-4590-b5a7-1b1ed566d83f tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] [instance: 1359a6b5-e39c-461f-96a3-f7772b7bd441] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:06.585434 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1fdf7c8c-d4af-4590-b5a7-1b1ed566d83f tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186f031d59c648179182421732afb9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca1fcaaa64943c588c2963490ef2fe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:06.595807 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1fdf7c8c-d4af-4590-b5a7-1b1ed566d83f tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] 10.222.0.76 "GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441" status: 200 len: 1215 microversion: 2.1 time: 0.336285 Oct 28 08:52:06.602753 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 698/1383] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:06 2021] GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441 => generated 1215 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:07.613264 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f1cae2f1-de17-4807-a0b9-107c90e3e85c tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:07.613871 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f1cae2f1-de17-4807-a0b9-107c90e3e85c tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] [instance: 1359a6b5-e39c-461f-96a3-f7772b7bd441] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:07.620700 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1cae2f1-de17-4807-a0b9-107c90e3e85c tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:07.621220 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1cae2f1-de17-4807-a0b9-107c90e3e85c tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:07.622705 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1cae2f1-de17-4807-a0b9-107c90e3e85c tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:07.623147 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1cae2f1-de17-4807-a0b9-107c90e3e85c tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:07.695196 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-f1cae2f1-de17-4807-a0b9-107c90e3e85c tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186f031d59c648179182421732afb9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca1fcaaa64943c588c2963490ef2fe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:07.702955 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f1cae2f1-de17-4807-a0b9-107c90e3e85c tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] 10.222.0.76 "GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441" status: 200 len: 1273 microversion: 2.1 time: 0.093473 Oct 28 08:52:07.703546 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 686/1384] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:07 2021] GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441 => generated 1273 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:08.723304 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-da7135c1-22f8-4d9e-b940-ba58dd6ab7ea tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:08.724741 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-da7135c1-22f8-4d9e-b940-ba58dd6ab7ea tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] [instance: 1359a6b5-e39c-461f-96a3-f7772b7bd441] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:08.733814 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da7135c1-22f8-4d9e-b940-ba58dd6ab7ea tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:08.734840 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da7135c1-22f8-4d9e-b940-ba58dd6ab7ea tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:08.735921 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da7135c1-22f8-4d9e-b940-ba58dd6ab7ea tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:08.736630 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da7135c1-22f8-4d9e-b940-ba58dd6ab7ea tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:08.982798 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-da7135c1-22f8-4d9e-b940-ba58dd6ab7ea tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186f031d59c648179182421732afb9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca1fcaaa64943c588c2963490ef2fe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:08.993766 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-da7135c1-22f8-4d9e-b940-ba58dd6ab7ea tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] 10.222.0.76 "GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441" status: 200 len: 1315 microversion: 2.1 time: 0.274877 Oct 28 08:52:08.994380 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 699/1385] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:08 2021] GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:09.093683 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-12858162-cafb-48ef-844f-7ba45db2c903 req-224458a9-6289-449d-ad17-525152b0cbfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1359a6b5-e39c-461f-96a3-f7772b7bd441", "tag": "b6f3b991-3a4d-4497-8baa-38904f3fc2d5"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:52:09.096837 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:52:09.096837 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:52:09.115913 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-12858162-cafb-48ef-844f-7ba45db2c903 req-224458a9-6289-449d-ad17-525152b0cbfa service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:09.117094 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-12858162-cafb-48ef-844f-7ba45db2c903 req-224458a9-6289-449d-ad17-525152b0cbfa service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:09.138946 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-12858162-cafb-48ef-844f-7ba45db2c903 req-224458a9-6289-449d-ad17-525152b0cbfa service nova] Creating event network-changed:b6f3b991-3a4d-4497-8baa-38904f3fc2d5 for instance 1359a6b5-e39c-461f-96a3-f7772b7bd441 on hv-cinder-81565 Oct 28 08:52:09.145446 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-12858162-cafb-48ef-844f-7ba45db2c903 req-224458a9-6289-449d-ad17-525152b0cbfa service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060472 Oct 28 08:52:09.146452 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 687/1386] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:52:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:52:10.014522 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-06b93877-2eb9-4655-84c7-ab61d11be0a0 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:10.015162 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-06b93877-2eb9-4655-84c7-ab61d11be0a0 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] [instance: 1359a6b5-e39c-461f-96a3-f7772b7bd441] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:10.021563 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06b93877-2eb9-4655-84c7-ab61d11be0a0 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:10.022042 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06b93877-2eb9-4655-84c7-ab61d11be0a0 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:10.022886 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06b93877-2eb9-4655-84c7-ab61d11be0a0 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:10.023380 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06b93877-2eb9-4655-84c7-ab61d11be0a0 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:10.228344 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-06b93877-2eb9-4655-84c7-ab61d11be0a0 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186f031d59c648179182421732afb9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca1fcaaa64943c588c2963490ef2fe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:10.237122 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-06b93877-2eb9-4655-84c7-ab61d11be0a0 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] 10.222.0.76 "GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441" status: 200 len: 1315 microversion: 2.1 time: 0.227424 Oct 28 08:52:10.237696 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 700/1387] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:10 2021] GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:11.255968 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-189cade9-1c6b-4038-b8c8-6730b5e658c5 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:11.256698 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-189cade9-1c6b-4038-b8c8-6730b5e658c5 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] [instance: 1359a6b5-e39c-461f-96a3-f7772b7bd441] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:11.263522 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-189cade9-1c6b-4038-b8c8-6730b5e658c5 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:11.263971 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-189cade9-1c6b-4038-b8c8-6730b5e658c5 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:11.264746 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-189cade9-1c6b-4038-b8c8-6730b5e658c5 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:11.265183 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-189cade9-1c6b-4038-b8c8-6730b5e658c5 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:11.411493 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-189cade9-1c6b-4038-b8c8-6730b5e658c5 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186f031d59c648179182421732afb9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca1fcaaa64943c588c2963490ef2fe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:11.420887 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-189cade9-1c6b-4038-b8c8-6730b5e658c5 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] 10.222.0.76 "GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441" status: 200 len: 1315 microversion: 2.1 time: 0.169487 Oct 28 08:52:11.421500 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 688/1388] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:11 2021] GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:12.438464 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eaf13087-f464-457e-8bf6-d8f58ad98504 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:12.439066 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eaf13087-f464-457e-8bf6-d8f58ad98504 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] [instance: 1359a6b5-e39c-461f-96a3-f7772b7bd441] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:12.445804 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eaf13087-f464-457e-8bf6-d8f58ad98504 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:12.446261 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eaf13087-f464-457e-8bf6-d8f58ad98504 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:12.447103 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eaf13087-f464-457e-8bf6-d8f58ad98504 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:12.447550 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eaf13087-f464-457e-8bf6-d8f58ad98504 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:12.582188 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-eaf13087-f464-457e-8bf6-d8f58ad98504 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186f031d59c648179182421732afb9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca1fcaaa64943c588c2963490ef2fe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:12.591237 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eaf13087-f464-457e-8bf6-d8f58ad98504 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] 10.222.0.76 "GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441" status: 200 len: 1315 microversion: 2.1 time: 0.157700 Oct 28 08:52:12.591815 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 701/1389] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:12 2021] GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:13.609393 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eccd7d6e-4df7-47d5-a52c-e270058c187d tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:13.610019 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-eccd7d6e-4df7-47d5-a52c-e270058c187d tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] [instance: 1359a6b5-e39c-461f-96a3-f7772b7bd441] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:13.616649 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eccd7d6e-4df7-47d5-a52c-e270058c187d tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:13.617096 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eccd7d6e-4df7-47d5-a52c-e270058c187d tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:13.617889 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eccd7d6e-4df7-47d5-a52c-e270058c187d tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:13.618315 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eccd7d6e-4df7-47d5-a52c-e270058c187d tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:13.742740 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-eccd7d6e-4df7-47d5-a52c-e270058c187d tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186f031d59c648179182421732afb9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca1fcaaa64943c588c2963490ef2fe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:13.750227 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eccd7d6e-4df7-47d5-a52c-e270058c187d tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] 10.222.0.76 "GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441" status: 200 len: 1315 microversion: 2.1 time: 0.145188 Oct 28 08:52:13.750832 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 689/1390] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:13 2021] GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:14.768745 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0d725dbf-54e2-4ade-bd53-7d10a62ac9ce tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:14.769372 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0d725dbf-54e2-4ade-bd53-7d10a62ac9ce tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] [instance: 1359a6b5-e39c-461f-96a3-f7772b7bd441] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:14.776151 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d725dbf-54e2-4ade-bd53-7d10a62ac9ce tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:14.776599 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d725dbf-54e2-4ade-bd53-7d10a62ac9ce tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:14.777524 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d725dbf-54e2-4ade-bd53-7d10a62ac9ce tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:14.777970 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d725dbf-54e2-4ade-bd53-7d10a62ac9ce tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:14.929591 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-0d725dbf-54e2-4ade-bd53-7d10a62ac9ce tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186f031d59c648179182421732afb9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca1fcaaa64943c588c2963490ef2fe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:14.938446 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0d725dbf-54e2-4ade-bd53-7d10a62ac9ce tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] 10.222.0.76 "GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441" status: 200 len: 1315 microversion: 2.1 time: 0.173949 Oct 28 08:52:14.939082 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 702/1391] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:14 2021] GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:52:15.960464 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-18ad7f20-585f-4b52-bdd8-0e44e5187fd9 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:15.961362 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-18ad7f20-585f-4b52-bdd8-0e44e5187fd9 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] [instance: 1359a6b5-e39c-461f-96a3-f7772b7bd441] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:15.969862 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18ad7f20-585f-4b52-bdd8-0e44e5187fd9 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:15.970304 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18ad7f20-585f-4b52-bdd8-0e44e5187fd9 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:15.971114 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18ad7f20-585f-4b52-bdd8-0e44e5187fd9 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:15.971553 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18ad7f20-585f-4b52-bdd8-0e44e5187fd9 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:16.103978 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-18ad7f20-585f-4b52-bdd8-0e44e5187fd9 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186f031d59c648179182421732afb9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca1fcaaa64943c588c2963490ef2fe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:16.112755 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-18ad7f20-585f-4b52-bdd8-0e44e5187fd9 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] 10.222.0.76 "GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441" status: 200 len: 1315 microversion: 2.1 time: 0.156066 Oct 28 08:52:16.113330 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 690/1392] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:15 2021] GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:17.129947 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1e2d726a-88ad-477b-b041-8091962510ad tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:17.130663 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1e2d726a-88ad-477b-b041-8091962510ad tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] [instance: 1359a6b5-e39c-461f-96a3-f7772b7bd441] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:17.137092 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e2d726a-88ad-477b-b041-8091962510ad tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:17.137522 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e2d726a-88ad-477b-b041-8091962510ad tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:17.138285 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e2d726a-88ad-477b-b041-8091962510ad tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:17.138734 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e2d726a-88ad-477b-b041-8091962510ad tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:17.272765 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1e2d726a-88ad-477b-b041-8091962510ad tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186f031d59c648179182421732afb9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca1fcaaa64943c588c2963490ef2fe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:17.281109 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1e2d726a-88ad-477b-b041-8091962510ad tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] 10.222.0.76 "GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441" status: 200 len: 1315 microversion: 2.1 time: 0.154729 Oct 28 08:52:17.281690 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 703/1393] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:17 2021] GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:18.300146 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-560b6b32-08c9-48f9-ad1c-ee748d052133 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:18.300146 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-560b6b32-08c9-48f9-ad1c-ee748d052133 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] [instance: 1359a6b5-e39c-461f-96a3-f7772b7bd441] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:18.307384 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-560b6b32-08c9-48f9-ad1c-ee748d052133 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:18.307833 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-560b6b32-08c9-48f9-ad1c-ee748d052133 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:18.309276 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-560b6b32-08c9-48f9-ad1c-ee748d052133 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:18.309714 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-560b6b32-08c9-48f9-ad1c-ee748d052133 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:18.452884 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-560b6b32-08c9-48f9-ad1c-ee748d052133 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186f031d59c648179182421732afb9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca1fcaaa64943c588c2963490ef2fe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:18.460723 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-560b6b32-08c9-48f9-ad1c-ee748d052133 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] 10.222.0.76 "GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441" status: 200 len: 1315 microversion: 2.1 time: 0.165791 Oct 28 08:52:18.461823 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 691/1394] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:18 2021] GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:19.478103 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-74fbb40b-c584-4d72-b0c4-9a07dc4fe182 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:19.478722 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-74fbb40b-c584-4d72-b0c4-9a07dc4fe182 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] [instance: 1359a6b5-e39c-461f-96a3-f7772b7bd441] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:19.485791 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74fbb40b-c584-4d72-b0c4-9a07dc4fe182 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:19.486226 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74fbb40b-c584-4d72-b0c4-9a07dc4fe182 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:19.487021 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74fbb40b-c584-4d72-b0c4-9a07dc4fe182 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:19.487455 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74fbb40b-c584-4d72-b0c4-9a07dc4fe182 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:19.623938 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-74fbb40b-c584-4d72-b0c4-9a07dc4fe182 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186f031d59c648179182421732afb9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca1fcaaa64943c588c2963490ef2fe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:19.632400 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-74fbb40b-c584-4d72-b0c4-9a07dc4fe182 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] 10.222.0.76 "GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441" status: 200 len: 1315 microversion: 2.1 time: 0.157799 Oct 28 08:52:19.632982 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 704/1395] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:19 2021] GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:20.206885 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-97175fee-ec0d-4e6a-9122-68a83e4ecd8c req-6b639d89-03cb-4ec6-9007-9f41f7fae7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1359a6b5-e39c-461f-96a3-f7772b7bd441", "name": "network-vif-plugged", "status": "completed", "tag": "b6f3b991-3a4d-4497-8baa-38904f3fc2d5"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:52:20.208404 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:52:20.208404 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:52:20.218293 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-97175fee-ec0d-4e6a-9122-68a83e4ecd8c req-6b639d89-03cb-4ec6-9007-9f41f7fae7d6 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:20.218731 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-97175fee-ec0d-4e6a-9122-68a83e4ecd8c req-6b639d89-03cb-4ec6-9007-9f41f7fae7d6 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:20.231827 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-97175fee-ec0d-4e6a-9122-68a83e4ecd8c req-6b639d89-03cb-4ec6-9007-9f41f7fae7d6 service nova] Creating event network-vif-plugged:b6f3b991-3a4d-4497-8baa-38904f3fc2d5 for instance 1359a6b5-e39c-461f-96a3-f7772b7bd441 on hv-cinder-81565 Oct 28 08:52:20.237678 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-97175fee-ec0d-4e6a-9122-68a83e4ecd8c req-6b639d89-03cb-4ec6-9007-9f41f7fae7d6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034250 Oct 28 08:52:20.238377 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 692/1396] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:52:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:52:20.650115 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1445b258-3376-4257-b55e-eae33ac78aa3 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:20.650793 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1445b258-3376-4257-b55e-eae33ac78aa3 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] [instance: 1359a6b5-e39c-461f-96a3-f7772b7bd441] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:20.657664 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1445b258-3376-4257-b55e-eae33ac78aa3 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:20.657999 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1445b258-3376-4257-b55e-eae33ac78aa3 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:20.658879 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1445b258-3376-4257-b55e-eae33ac78aa3 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:20.659294 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1445b258-3376-4257-b55e-eae33ac78aa3 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:20.785622 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1445b258-3376-4257-b55e-eae33ac78aa3 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186f031d59c648179182421732afb9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca1fcaaa64943c588c2963490ef2fe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:20.793411 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1445b258-3376-4257-b55e-eae33ac78aa3 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] 10.222.0.76 "GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441" status: 200 len: 1315 microversion: 2.1 time: 0.146644 Oct 28 08:52:20.794656 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 705/1397] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:20 2021] GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:21.812847 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dac0d88f-75e6-4de4-8f9f-861e87a18dd7 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:21.813541 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dac0d88f-75e6-4de4-8f9f-861e87a18dd7 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] [instance: 1359a6b5-e39c-461f-96a3-f7772b7bd441] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:21.820222 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dac0d88f-75e6-4de4-8f9f-861e87a18dd7 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:21.820665 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dac0d88f-75e6-4de4-8f9f-861e87a18dd7 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:21.821441 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dac0d88f-75e6-4de4-8f9f-861e87a18dd7 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:21.821871 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dac0d88f-75e6-4de4-8f9f-861e87a18dd7 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:21.957201 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-dac0d88f-75e6-4de4-8f9f-861e87a18dd7 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186f031d59c648179182421732afb9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca1fcaaa64943c588c2963490ef2fe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:21.964907 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dac0d88f-75e6-4de4-8f9f-861e87a18dd7 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] 10.222.0.76 "GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441" status: 200 len: 1315 microversion: 2.1 time: 0.157051 Oct 28 08:52:21.965613 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 693/1398] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:21 2021] GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:22.983999 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0a0db16e-25a8-4a06-92db-69c22240ae20 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:22.984553 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0a0db16e-25a8-4a06-92db-69c22240ae20 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] [instance: 1359a6b5-e39c-461f-96a3-f7772b7bd441] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:22.991233 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a0db16e-25a8-4a06-92db-69c22240ae20 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:22.991674 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a0db16e-25a8-4a06-92db-69c22240ae20 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:22.992437 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a0db16e-25a8-4a06-92db-69c22240ae20 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:22.992895 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a0db16e-25a8-4a06-92db-69c22240ae20 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:23.131654 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-0a0db16e-25a8-4a06-92db-69c22240ae20 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186f031d59c648179182421732afb9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca1fcaaa64943c588c2963490ef2fe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:23.140103 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0a0db16e-25a8-4a06-92db-69c22240ae20 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] 10.222.0.76 "GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441" status: 200 len: 1315 microversion: 2.1 time: 0.161664 Oct 28 08:52:23.140699 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 706/1399] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:22 2021] GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:24.159799 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5cbadf09-dead-4f58-afec-4f57bcc27dca tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:24.160506 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5cbadf09-dead-4f58-afec-4f57bcc27dca tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] [instance: 1359a6b5-e39c-461f-96a3-f7772b7bd441] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:24.167183 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5cbadf09-dead-4f58-afec-4f57bcc27dca tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:24.167627 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5cbadf09-dead-4f58-afec-4f57bcc27dca tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:24.169638 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5cbadf09-dead-4f58-afec-4f57bcc27dca tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:24.170068 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5cbadf09-dead-4f58-afec-4f57bcc27dca tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:24.298343 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-5cbadf09-dead-4f58-afec-4f57bcc27dca tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186f031d59c648179182421732afb9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca1fcaaa64943c588c2963490ef2fe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:24.305818 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5cbadf09-dead-4f58-afec-4f57bcc27dca tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] 10.222.0.76 "GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441" status: 200 len: 1315 microversion: 2.1 time: 0.152246 Oct 28 08:52:24.306408 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 694/1400] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:24 2021] GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:52:25.327534 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3c89220f-dd29-40c8-8cc2-60bb611d9613 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:25.328711 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3c89220f-dd29-40c8-8cc2-60bb611d9613 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] [instance: 1359a6b5-e39c-461f-96a3-f7772b7bd441] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:25.341683 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c89220f-dd29-40c8-8cc2-60bb611d9613 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:25.342391 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c89220f-dd29-40c8-8cc2-60bb611d9613 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:25.343352 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c89220f-dd29-40c8-8cc2-60bb611d9613 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:25.344239 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c89220f-dd29-40c8-8cc2-60bb611d9613 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:25.504647 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3c89220f-dd29-40c8-8cc2-60bb611d9613 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186f031d59c648179182421732afb9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca1fcaaa64943c588c2963490ef2fe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:25.518467 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3c89220f-dd29-40c8-8cc2-60bb611d9613 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] 10.222.0.76 "GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441" status: 200 len: 1464 microversion: 2.1 time: 0.197566 Oct 28 08:52:25.519501 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 707/1401] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:25 2021] GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441 => generated 1464 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:25.578136 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bdc9247e-63d9-41da-b64c-f16c0ca40ef9 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:25.578705 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bdc9247e-63d9-41da-b64c-f16c0ca40ef9 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] [instance: 1359a6b5-e39c-461f-96a3-f7772b7bd441] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:25.585316 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdc9247e-63d9-41da-b64c-f16c0ca40ef9 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:25.585710 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdc9247e-63d9-41da-b64c-f16c0ca40ef9 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:25.587255 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdc9247e-63d9-41da-b64c-f16c0ca40ef9 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:25.588008 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdc9247e-63d9-41da-b64c-f16c0ca40ef9 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:25.619013 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bdc9247e-63d9-41da-b64c-f16c0ca40ef9 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] [instance: 1359a6b5-e39c-461f-96a3-f7772b7bd441] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:52:25.731726 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bdc9247e-63d9-41da-b64c-f16c0ca40ef9 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] 10.222.0.76 "DELETE /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441" status: 204 len: 0 microversion: 2.1 time: 0.155976 Oct 28 08:52:25.731726 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 695/1402] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Oct 28 08:52:25 2021] DELETE /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:52:25.740056 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7c565e88-63da-46fb-ab2a-943ecb569f6a tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:25.740659 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7c565e88-63da-46fb-ab2a-943ecb569f6a tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] [instance: 1359a6b5-e39c-461f-96a3-f7772b7bd441] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:25.748060 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c565e88-63da-46fb-ab2a-943ecb569f6a tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:25.748495 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c565e88-63da-46fb-ab2a-943ecb569f6a tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:25.749267 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c565e88-63da-46fb-ab2a-943ecb569f6a tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:25.749729 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c565e88-63da-46fb-ab2a-943ecb569f6a tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:25.890991 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-7c565e88-63da-46fb-ab2a-943ecb569f6a tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186f031d59c648179182421732afb9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca1fcaaa64943c588c2963490ef2fe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:25.900145 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7c565e88-63da-46fb-ab2a-943ecb569f6a tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] 10.222.0.76 "GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441" status: 200 len: 1470 microversion: 2.1 time: 0.163863 Oct 28 08:52:25.900895 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 708/1403] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:25 2021] GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441 => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:52:26.925361 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1dbffcdc-96d3-42ee-9f27-0b3963bc0d75 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:26.926056 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1dbffcdc-96d3-42ee-9f27-0b3963bc0d75 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] [instance: 1359a6b5-e39c-461f-96a3-f7772b7bd441] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:26.933945 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1dbffcdc-96d3-42ee-9f27-0b3963bc0d75 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:26.934397 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1dbffcdc-96d3-42ee-9f27-0b3963bc0d75 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:26.935229 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1dbffcdc-96d3-42ee-9f27-0b3963bc0d75 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:26.935661 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1dbffcdc-96d3-42ee-9f27-0b3963bc0d75 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:27.070351 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-1dbffcdc-96d3-42ee-9f27-0b3963bc0d75 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186f031d59c648179182421732afb9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca1fcaaa64943c588c2963490ef2fe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:27.078316 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1dbffcdc-96d3-42ee-9f27-0b3963bc0d75 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] 10.222.0.76 "GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441" status: 200 len: 1470 microversion: 2.1 time: 0.157234 Oct 28 08:52:27.078937 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 696/1404] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:26 2021] GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:28.097760 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2798e77e-0df2-4879-bd41-cefed46e0e43 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:28.098789 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2798e77e-0df2-4879-bd41-cefed46e0e43 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] [instance: 1359a6b5-e39c-461f-96a3-f7772b7bd441] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:28.106687 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2798e77e-0df2-4879-bd41-cefed46e0e43 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:28.107137 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2798e77e-0df2-4879-bd41-cefed46e0e43 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:28.107918 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2798e77e-0df2-4879-bd41-cefed46e0e43 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:28.108348 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2798e77e-0df2-4879-bd41-cefed46e0e43 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:28.238162 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-2798e77e-0df2-4879-bd41-cefed46e0e43 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186f031d59c648179182421732afb9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca1fcaaa64943c588c2963490ef2fe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:28.247663 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2798e77e-0df2-4879-bd41-cefed46e0e43 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] 10.222.0.76 "GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441" status: 200 len: 1470 microversion: 2.1 time: 0.155483 Oct 28 08:52:28.248247 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 709/1405] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:28 2021] GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:29.265255 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-34b809cb-4592-4832-b1d4-a33baa35df07 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:29.266063 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-34b809cb-4592-4832-b1d4-a33baa35df07 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] [instance: 1359a6b5-e39c-461f-96a3-f7772b7bd441] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:29.273203 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34b809cb-4592-4832-b1d4-a33baa35df07 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:29.273642 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34b809cb-4592-4832-b1d4-a33baa35df07 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:29.274417 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34b809cb-4592-4832-b1d4-a33baa35df07 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:29.274863 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34b809cb-4592-4832-b1d4-a33baa35df07 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:29.406242 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-34b809cb-4592-4832-b1d4-a33baa35df07 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186f031d59c648179182421732afb9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca1fcaaa64943c588c2963490ef2fe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:29.413818 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-34b809cb-4592-4832-b1d4-a33baa35df07 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] 10.222.0.76 "GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441" status: 200 len: 1470 microversion: 2.1 time: 0.152486 Oct 28 08:52:29.414398 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 697/1406] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:29 2021] GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:30.431970 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0e4d347e-dc89-4db9-96f0-26d339d106be tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:30.432567 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0e4d347e-dc89-4db9-96f0-26d339d106be tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] [instance: 1359a6b5-e39c-461f-96a3-f7772b7bd441] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:30.439569 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e4d347e-dc89-4db9-96f0-26d339d106be tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:30.440009 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e4d347e-dc89-4db9-96f0-26d339d106be tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:30.440802 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e4d347e-dc89-4db9-96f0-26d339d106be tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:30.441206 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e4d347e-dc89-4db9-96f0-26d339d106be tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:30.576904 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-0e4d347e-dc89-4db9-96f0-26d339d106be tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186f031d59c648179182421732afb9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca1fcaaa64943c588c2963490ef2fe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:30.584532 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0e4d347e-dc89-4db9-96f0-26d339d106be tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] 10.222.0.76 "GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441" status: 200 len: 1470 microversion: 2.1 time: 0.156286 Oct 28 08:52:30.585093 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 710/1407] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:30 2021] GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:31.112735 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-750a3ad4-1b61-470e-880d-ae6666c59a26 req-185617c3-7c98-44d5-9a90-56814ad87fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1359a6b5-e39c-461f-96a3-f7772b7bd441", "name": "network-vif-deleted", "tag": "b6f3b991-3a4d-4497-8baa-38904f3fc2d5"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:52:31.114486 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:52:31.114486 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:52:31.122224 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-750a3ad4-1b61-470e-880d-ae6666c59a26 req-185617c3-7c98-44d5-9a90-56814ad87fa9 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:31.122992 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-750a3ad4-1b61-470e-880d-ae6666c59a26 req-185617c3-7c98-44d5-9a90-56814ad87fa9 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:31.139017 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-750a3ad4-1b61-470e-880d-ae6666c59a26 req-185617c3-7c98-44d5-9a90-56814ad87fa9 service nova] Creating event network-vif-deleted:b6f3b991-3a4d-4497-8baa-38904f3fc2d5 for instance 1359a6b5-e39c-461f-96a3-f7772b7bd441 on hv-cinder-81565 Oct 28 08:52:31.145921 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-750a3ad4-1b61-470e-880d-ae6666c59a26 req-185617c3-7c98-44d5-9a90-56814ad87fa9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036626 Oct 28 08:52:31.146933 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 698/1408] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:52:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:52:31.601242 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-40c3761f-7bed-4f5a-91e3-08d63d0af826 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:31.601864 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-40c3761f-7bed-4f5a-91e3-08d63d0af826 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] [instance: 1359a6b5-e39c-461f-96a3-f7772b7bd441] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:31.609640 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-40c3761f-7bed-4f5a-91e3-08d63d0af826 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:31.610119 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-40c3761f-7bed-4f5a-91e3-08d63d0af826 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:31.610979 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-40c3761f-7bed-4f5a-91e3-08d63d0af826 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:31.611412 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-40c3761f-7bed-4f5a-91e3-08d63d0af826 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:31.648649 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-40c3761f-7bed-4f5a-91e3-08d63d0af826 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:31.649203 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-40c3761f-7bed-4f5a-91e3-08d63d0af826 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:31.649715 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-40c3761f-7bed-4f5a-91e3-08d63d0af826 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lazy-loading 'fault' on Instance uuid 1359a6b5-e39c-461f-96a3-f7772b7bd441 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:52:31.703543 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-40c3761f-7bed-4f5a-91e3-08d63d0af826 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186f031d59c648179182421732afb9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca1fcaaa64943c588c2963490ef2fe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:31.710782 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-40c3761f-7bed-4f5a-91e3-08d63d0af826 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] 10.222.0.76 "GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441" status: 200 len: 1305 microversion: 2.1 time: 0.113324 Oct 28 08:52:31.711623 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 711/1409] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:31 2021] GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441 => generated 1305 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:32.731179 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d183b85b-4c54-4529-a86e-e8f834d06d70 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:32.731888 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d183b85b-4c54-4529-a86e-e8f834d06d70 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] [instance: 1359a6b5-e39c-461f-96a3-f7772b7bd441] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:32.740303 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d183b85b-4c54-4529-a86e-e8f834d06d70 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:32.740746 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d183b85b-4c54-4529-a86e-e8f834d06d70 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:32.741525 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d183b85b-4c54-4529-a86e-e8f834d06d70 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:32.741954 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d183b85b-4c54-4529-a86e-e8f834d06d70 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:32.756478 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-d183b85b-4c54-4529-a86e-e8f834d06d70 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] HTTP exception thrown: Instance 1359a6b5-e39c-461f-96a3-f7772b7bd441 could not be found. Oct 28 08:52:32.757180 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d183b85b-4c54-4529-a86e-e8f834d06d70 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] Returning 404 to user: Instance 1359a6b5-e39c-461f-96a3-f7772b7bd441 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:52:32.758177 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d183b85b-4c54-4529-a86e-e8f834d06d70 tempest-VolumesNegativeTest-1637322285 tempest-VolumesNegativeTest-1637322285-project] 10.222.0.76 "GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441" status: 404 len: 111 microversion: 2.1 time: 0.032593 Oct 28 08:52:32.758848 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 699/1410] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:32 2021] GET /compute/v2.1/servers/1359a6b5-e39c-461f-96a3-f7772b7bd441 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:52:34.144405 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-06d9ff8c-ef9c-4fcc-aa57-1e2d43b63b61 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:34.145341 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-06d9ff8c-ef9c-4fcc-aa57-1e2d43b63b61 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: 2f51bb90-b4e0-485a-9db4-898212fc5867] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:34.151654 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06d9ff8c-ef9c-4fcc-aa57-1e2d43b63b61 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:34.152120 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06d9ff8c-ef9c-4fcc-aa57-1e2d43b63b61 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:34.153205 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06d9ff8c-ef9c-4fcc-aa57-1e2d43b63b61 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:34.153588 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06d9ff8c-ef9c-4fcc-aa57-1e2d43b63b61 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:34.269291 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-06d9ff8c-ef9c-4fcc-aa57-1e2d43b63b61 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lazy-loading 'services' on Instance uuid 2f51bb90-b4e0-485a-9db4-898212fc5867 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:52:34.350349 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-06d9ff8c-ef9c-4fcc-aa57-1e2d43b63b61 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "DELETE /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867/os-volume_attachments/c330b7e1-adc9-42d0-9713-413bd5e2440f" status: 202 len: 0 microversion: 2.1 time: 0.210536 Oct 28 08:52:34.351344 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 712/1411] 10.222.0.76 () {58 vars in 1415 bytes} [Thu Oct 28 08:52:34 2021] DELETE /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867/os-volume_attachments/c330b7e1-adc9-42d0-9713-413bd5e2440f => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:52:35.474693 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9024221c-364b-47be-9625-a5c277a928e9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:35.475289 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9024221c-364b-47be-9625-a5c277a928e9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: 2f51bb90-b4e0-485a-9db4-898212fc5867] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:35.482065 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9024221c-364b-47be-9625-a5c277a928e9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:35.482515 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9024221c-364b-47be-9625-a5c277a928e9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:35.483309 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9024221c-364b-47be-9625-a5c277a928e9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:35.483750 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9024221c-364b-47be-9625-a5c277a928e9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:35.509396 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9024221c-364b-47be-9625-a5c277a928e9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: 2f51bb90-b4e0-485a-9db4-898212fc5867] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:52:35.591615 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9024221c-364b-47be-9625-a5c277a928e9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "DELETE /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867" status: 204 len: 0 microversion: 2.1 time: 0.120159 Oct 28 08:52:35.592148 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 700/1412] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Oct 28 08:52:35 2021] DELETE /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:52:35.604032 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a847edfb-1a6f-4089-9114-c6c95891a150 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:35.604875 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a847edfb-1a6f-4089-9114-c6c95891a150 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: 2f51bb90-b4e0-485a-9db4-898212fc5867] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:35.611205 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a847edfb-1a6f-4089-9114-c6c95891a150 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:35.611650 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a847edfb-1a6f-4089-9114-c6c95891a150 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:35.612455 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a847edfb-1a6f-4089-9114-c6c95891a150 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:35.612884 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a847edfb-1a6f-4089-9114-c6c95891a150 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:35.741511 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-a847edfb-1a6f-4089-9114-c6c95891a150 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:35.750004 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a847edfb-1a6f-4089-9114-c6c95891a150 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867" status: 200 len: 1514 microversion: 2.1 time: 0.151310 Oct 28 08:52:35.750587 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 713/1413] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:35 2021] GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:36.767671 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a35cead7-035c-418a-b7dc-cde5d8354e4f tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:36.768386 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a35cead7-035c-418a-b7dc-cde5d8354e4f tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: 2f51bb90-b4e0-485a-9db4-898212fc5867] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:36.775248 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a35cead7-035c-418a-b7dc-cde5d8354e4f tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:36.775693 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a35cead7-035c-418a-b7dc-cde5d8354e4f tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:36.776493 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a35cead7-035c-418a-b7dc-cde5d8354e4f tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:36.777540 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a35cead7-035c-418a-b7dc-cde5d8354e4f tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:36.948301 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-a35cead7-035c-418a-b7dc-cde5d8354e4f tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:36.956660 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a35cead7-035c-418a-b7dc-cde5d8354e4f tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867" status: 200 len: 1514 microversion: 2.1 time: 0.192836 Oct 28 08:52:36.957181 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 701/1414] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:36 2021] GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867 => generated 1514 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:52:37.974738 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1eeaa65a-ae0b-484f-9765-a48f228e7db2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:37.976044 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1eeaa65a-ae0b-484f-9765-a48f228e7db2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: 2f51bb90-b4e0-485a-9db4-898212fc5867] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:37.983470 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1eeaa65a-ae0b-484f-9765-a48f228e7db2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:37.983936 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1eeaa65a-ae0b-484f-9765-a48f228e7db2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:37.984705 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1eeaa65a-ae0b-484f-9765-a48f228e7db2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:37.985137 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1eeaa65a-ae0b-484f-9765-a48f228e7db2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:38.065196 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1eeaa65a-ae0b-484f-9765-a48f228e7db2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:38.082442 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1eeaa65a-ae0b-484f-9765-a48f228e7db2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867" status: 200 len: 1472 microversion: 2.1 time: 0.105260 Oct 28 08:52:38.082442 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 714/1415] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:37 2021] GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867 => generated 1472 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:38.156484 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-552c8717-611b-4936-9e8a-0534945d56c2 req-1881407d-57e0-49be-a67a-d93506768425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f51bb90-b4e0-485a-9db4-898212fc5867", "name": "network-vif-deleted", "tag": "4f65f654-4e7d-486a-97f4-1d691a0b976b"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:52:38.158115 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:52:38.158115 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:52:38.182484 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-552c8717-611b-4936-9e8a-0534945d56c2 req-1881407d-57e0-49be-a67a-d93506768425 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:38.183980 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-552c8717-611b-4936-9e8a-0534945d56c2 req-1881407d-57e0-49be-a67a-d93506768425 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:38.203691 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-552c8717-611b-4936-9e8a-0534945d56c2 req-1881407d-57e0-49be-a67a-d93506768425 service nova] Creating event network-vif-deleted:4f65f654-4e7d-486a-97f4-1d691a0b976b for instance 2f51bb90-b4e0-485a-9db4-898212fc5867 on hv-cinder-81565 Oct 28 08:52:38.212524 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-552c8717-611b-4936-9e8a-0534945d56c2 req-1881407d-57e0-49be-a67a-d93506768425 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061069 Oct 28 08:52:38.213633 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 702/1416] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:52:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:52:39.097377 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-df4ad24c-841e-42d5-beb2-f303847b0a91 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:39.099114 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-df4ad24c-841e-42d5-beb2-f303847b0a91 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: 2f51bb90-b4e0-485a-9db4-898212fc5867] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:39.110864 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df4ad24c-841e-42d5-beb2-f303847b0a91 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:39.111438 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df4ad24c-841e-42d5-beb2-f303847b0a91 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:39.112586 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df4ad24c-841e-42d5-beb2-f303847b0a91 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:39.113492 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df4ad24c-841e-42d5-beb2-f303847b0a91 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:39.132357 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-df4ad24c-841e-42d5-beb2-f303847b0a91 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] HTTP exception thrown: Instance 2f51bb90-b4e0-485a-9db4-898212fc5867 could not be found. Oct 28 08:52:39.133037 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-df4ad24c-841e-42d5-beb2-f303847b0a91 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Returning 404 to user: Instance 2f51bb90-b4e0-485a-9db4-898212fc5867 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:52:39.140061 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-df4ad24c-841e-42d5-beb2-f303847b0a91 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867" status: 404 len: 111 microversion: 2.1 time: 0.047487 Oct 28 08:52:39.140659 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 715/1417] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:39 2021] GET /compute/v2.1/servers/2f51bb90-b4e0-485a-9db4-898212fc5867 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:52:50.547249 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f32def03-300b-4ed1-93d6-a5fcb2d2e2cd tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1934977792", "imageRef": "339e99be-6a19-4324-aa16-6b690c25dede", "flavorRef": "452", "networks": [{"uuid": "d1e85954-aa8d-4e2c-bf05-e2af5e402c65"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:52:50.633899 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-f32def03-300b-4ed1-93d6-a5fcb2d2e2cd tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] validate_networks() for [('d1e85954-aa8d-4e2c-bf05-e2af5e402c65', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:52:51.302516 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-f32def03-300b-4ed1-93d6-a5fcb2d2e2cd tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:52:51.303057 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-f32def03-300b-4ed1-93d6-a5fcb2d2e2cd tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:52:51.303748 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-f32def03-300b-4ed1-93d6-a5fcb2d2e2cd tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:52:51.304243 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-f32def03-300b-4ed1-93d6-a5fcb2d2e2cd tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:52:51.304860 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-f32def03-300b-4ed1-93d6-a5fcb2d2e2cd tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:52:51.321595 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f32def03-300b-4ed1-93d6-a5fcb2d2e2cd tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:51.322390 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f32def03-300b-4ed1-93d6-a5fcb2d2e2cd tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:51.324345 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f32def03-300b-4ed1-93d6-a5fcb2d2e2cd tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:51.325702 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f32def03-300b-4ed1-93d6-a5fcb2d2e2cd tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:51.353971 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-f32def03-300b-4ed1-93d6-a5fcb2d2e2cd tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Getting quotas for project 44c9c1891789491bbcae9bca7f8654f2. Resources: {'instances', 'cores', 'ram'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:52:51.358610 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-f32def03-300b-4ed1-93d6-a5fcb2d2e2cd tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Getting quotas for user 1ca3422951ef4ccc8f40838ba2532bbf and project 44c9c1891789491bbcae9bca7f8654f2. Resources: {'instances', 'cores', 'ram'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:52:51.371241 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f32def03-300b-4ed1-93d6-a5fcb2d2e2cd tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:52:51.374406 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f32def03-300b-4ed1-93d6-a5fcb2d2e2cd tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: dff389e3-85df-444f-9afa-4e4acc296656] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='339e99be-6a19-4324-aa16-6b690c25dede',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:52:51.447365 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f32def03-300b-4ed1-93d6-a5fcb2d2e2cd tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.905167 Oct 28 08:52:51.449187 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 703/1418] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Oct 28 08:52:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:52:51.463525 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-107b8fb9-40b8-4717-94c5-daec42c05bd2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:51.465571 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-107b8fb9-40b8-4717-94c5-daec42c05bd2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: dff389e3-85df-444f-9afa-4e4acc296656] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:51.544901 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-107b8fb9-40b8-4717-94c5-daec42c05bd2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:51.564188 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-107b8fb9-40b8-4717-94c5-daec42c05bd2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656" status: 200 len: 1219 microversion: 2.1 time: 0.106569 Oct 28 08:52:51.565136 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 716/1419] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:51 2021] GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656 => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:52.588061 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c1a5c39a-c5f6-4b98-8fc6-c2e53bacc7e9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:52.588770 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c1a5c39a-c5f6-4b98-8fc6-c2e53bacc7e9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: dff389e3-85df-444f-9afa-4e4acc296656] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:52.609781 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1a5c39a-c5f6-4b98-8fc6-c2e53bacc7e9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:52.616971 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1a5c39a-c5f6-4b98-8fc6-c2e53bacc7e9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:52.618067 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1a5c39a-c5f6-4b98-8fc6-c2e53bacc7e9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:52.618696 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1a5c39a-c5f6-4b98-8fc6-c2e53bacc7e9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:52.794009 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c1a5c39a-c5f6-4b98-8fc6-c2e53bacc7e9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:52.806672 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c1a5c39a-c5f6-4b98-8fc6-c2e53bacc7e9 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656" status: 200 len: 1271 microversion: 2.1 time: 0.226312 Oct 28 08:52:52.809151 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 704/1420] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:52 2021] GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656 => generated 1271 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:53.829123 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-184b72c4-fd62-49cf-862a-a24d8d32c269 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:53.829950 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-184b72c4-fd62-49cf-862a-a24d8d32c269 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: dff389e3-85df-444f-9afa-4e4acc296656] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:53.845362 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-184b72c4-fd62-49cf-862a-a24d8d32c269 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:53.846684 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-184b72c4-fd62-49cf-862a-a24d8d32c269 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:53.848965 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-184b72c4-fd62-49cf-862a-a24d8d32c269 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:53.849651 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-184b72c4-fd62-49cf-862a-a24d8d32c269 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:53.974531 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-184b72c4-fd62-49cf-862a-a24d8d32c269 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:53.986998 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-184b72c4-fd62-49cf-862a-a24d8d32c269 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656" status: 200 len: 1277 microversion: 2.1 time: 0.165076 Oct 28 08:52:53.993055 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 717/1421] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:53 2021] GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:55.019746 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-140cf186-bded-48bb-baf8-5488ff1931d5 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:55.020382 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-140cf186-bded-48bb-baf8-5488ff1931d5 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: dff389e3-85df-444f-9afa-4e4acc296656] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:55.028978 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-140cf186-bded-48bb-baf8-5488ff1931d5 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:55.029460 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-140cf186-bded-48bb-baf8-5488ff1931d5 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:55.030956 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-140cf186-bded-48bb-baf8-5488ff1931d5 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:55.030956 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-140cf186-bded-48bb-baf8-5488ff1931d5 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:55.305426 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-140cf186-bded-48bb-baf8-5488ff1931d5 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:55.325234 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-140cf186-bded-48bb-baf8-5488ff1931d5 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656" status: 200 len: 1319 microversion: 2.1 time: 0.310313 Oct 28 08:52:55.326630 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 705/1422] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:55 2021] GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656 => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:55.860765 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-c9ddc2cd-9202-4335-90e1-df152c888adb req-39e05dc8-4ec6-4e96-8386-21ac2635bce8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dff389e3-85df-444f-9afa-4e4acc296656", "tag": "be638b95-51cb-467e-b571-b524bc986fab"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:52:55.864169 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:52:55.864169 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:52:55.919087 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c9ddc2cd-9202-4335-90e1-df152c888adb req-39e05dc8-4ec6-4e96-8386-21ac2635bce8 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:55.919906 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c9ddc2cd-9202-4335-90e1-df152c888adb req-39e05dc8-4ec6-4e96-8386-21ac2635bce8 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:55.944236 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-c9ddc2cd-9202-4335-90e1-df152c888adb req-39e05dc8-4ec6-4e96-8386-21ac2635bce8 service nova] Creating event network-changed:be638b95-51cb-467e-b571-b524bc986fab for instance dff389e3-85df-444f-9afa-4e4acc296656 on hv-cinder-81565 Oct 28 08:52:55.955571 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-c9ddc2cd-9202-4335-90e1-df152c888adb req-39e05dc8-4ec6-4e96-8386-21ac2635bce8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101939 Oct 28 08:52:55.956601 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 718/1423] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:52:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:52:56.344409 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0f9280db-44c0-4d24-bb08-0e3495ae3d41 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:56.345914 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0f9280db-44c0-4d24-bb08-0e3495ae3d41 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: dff389e3-85df-444f-9afa-4e4acc296656] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:56.355337 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f9280db-44c0-4d24-bb08-0e3495ae3d41 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:56.355789 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f9280db-44c0-4d24-bb08-0e3495ae3d41 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:56.356770 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f9280db-44c0-4d24-bb08-0e3495ae3d41 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:56.357376 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f9280db-44c0-4d24-bb08-0e3495ae3d41 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:56.557218 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-0f9280db-44c0-4d24-bb08-0e3495ae3d41 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:56.570180 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0f9280db-44c0-4d24-bb08-0e3495ae3d41 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656" status: 200 len: 1319 microversion: 2.1 time: 0.229735 Oct 28 08:52:56.571073 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 706/1424] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:56 2021] GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:57.598969 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3a348218-83c0-43b0-bf1e-fb6a74a07b51 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:57.600174 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3a348218-83c0-43b0-bf1e-fb6a74a07b51 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: dff389e3-85df-444f-9afa-4e4acc296656] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:57.609053 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a348218-83c0-43b0-bf1e-fb6a74a07b51 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:57.609666 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a348218-83c0-43b0-bf1e-fb6a74a07b51 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:57.611215 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a348218-83c0-43b0-bf1e-fb6a74a07b51 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:57.611993 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a348218-83c0-43b0-bf1e-fb6a74a07b51 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:57.803589 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3a348218-83c0-43b0-bf1e-fb6a74a07b51 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:57.813078 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3a348218-83c0-43b0-bf1e-fb6a74a07b51 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656" status: 200 len: 1319 microversion: 2.1 time: 0.221143 Oct 28 08:52:57.814099 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 719/1425] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:57 2021] GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:52:58.833275 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9e8cd676-4c99-4484-b7db-09f5826c6d8c tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:52:58.834668 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9e8cd676-4c99-4484-b7db-09f5826c6d8c tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: dff389e3-85df-444f-9afa-4e4acc296656] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:52:58.842258 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e8cd676-4c99-4484-b7db-09f5826c6d8c tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:58.843225 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e8cd676-4c99-4484-b7db-09f5826c6d8c tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:58.844293 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e8cd676-4c99-4484-b7db-09f5826c6d8c tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:52:58.844723 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e8cd676-4c99-4484-b7db-09f5826c6d8c tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:52:59.005636 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-9e8cd676-4c99-4484-b7db-09f5826c6d8c tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:52:59.013997 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9e8cd676-4c99-4484-b7db-09f5826c6d8c tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656" status: 200 len: 1319 microversion: 2.1 time: 0.184327 Oct 28 08:52:59.027294 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 707/1426] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:52:58 2021] GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:00.032811 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-568fab20-0b7a-4acb-96ba-420a95371fce tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:00.033832 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-568fab20-0b7a-4acb-96ba-420a95371fce tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: dff389e3-85df-444f-9afa-4e4acc296656] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:00.040990 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-568fab20-0b7a-4acb-96ba-420a95371fce tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:00.041493 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-568fab20-0b7a-4acb-96ba-420a95371fce tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:00.043203 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-568fab20-0b7a-4acb-96ba-420a95371fce tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:00.043825 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-568fab20-0b7a-4acb-96ba-420a95371fce tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:00.201563 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-568fab20-0b7a-4acb-96ba-420a95371fce tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:00.209986 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-568fab20-0b7a-4acb-96ba-420a95371fce tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656" status: 200 len: 1319 microversion: 2.1 time: 0.181671 Oct 28 08:53:00.214716 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 720/1427] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:00 2021] GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:00.970787 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9137df5b-a677-4c26-a6c4-0110a6893c49 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Action: 'create', calling method: .version_select at 0x7fed6e8f9af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-361138060"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:53:00.989401 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-9137df5b-a677-4c26-a6c4-0110a6893c49 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Getting quotas for project a64a3a87a40249f8993dee5bc1950484. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:53:00.993603 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-9137df5b-a677-4c26-a6c4-0110a6893c49 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Getting quotas for user 1d00d9bbd6f1477eb0998236b921007e and project a64a3a87a40249f8993dee5bc1950484. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:53:01.008119 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9137df5b-a677-4c26-a6c4-0110a6893c49 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [8095aac3-9953-42fc-b0e8-221ad909bf9d] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 08:53:01.227851 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-32c7a2bb-f340-4070-8455-2e9b9cacdb8c tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:01.228467 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-32c7a2bb-f340-4070-8455-2e9b9cacdb8c tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: dff389e3-85df-444f-9afa-4e4acc296656] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:01.235274 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32c7a2bb-f340-4070-8455-2e9b9cacdb8c tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:01.235779 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32c7a2bb-f340-4070-8455-2e9b9cacdb8c tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:01.236581 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32c7a2bb-f340-4070-8455-2e9b9cacdb8c tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:01.237014 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32c7a2bb-f340-4070-8455-2e9b9cacdb8c tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:01.370766 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-32c7a2bb-f340-4070-8455-2e9b9cacdb8c tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:01.379082 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-32c7a2bb-f340-4070-8455-2e9b9cacdb8c tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656" status: 200 len: 1319 microversion: 2.1 time: 0.155041 Oct 28 08:53:01.379665 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 721/1428] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:01 2021] GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:53:02.024943 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [None req-9137df5b-a677-4c26-a6c4-0110a6893c49 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [8095aac3-9953-42fc-b0e8-221ad909bf9d] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 40858. Oct 28 08:53:02.224496 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-9137df5b-a677-4c26-a6c4-0110a6893c49 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Getting quotas for project a64a3a87a40249f8993dee5bc1950484. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:53:02.228103 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-9137df5b-a677-4c26-a6c4-0110a6893c49 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Getting quotas for user 1d00d9bbd6f1477eb0998236b921007e and project a64a3a87a40249f8993dee5bc1950484. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:53:02.241055 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9137df5b-a677-4c26-a6c4-0110a6893c49 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 1.273960 Oct 28 08:53:02.241662 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 708/1429] 10.222.0.76 () {60 vars in 1157 bytes} [Thu Oct 28 08:53:00 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:02.346735 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8d7a0b8d-7ffb-439d-9f8a-9bcd1271adcf tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1348718482", "imageRef": "9864ce53-d02e-4fb0-beaa-d890a25ec6ce", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-361138060", "networks": [{"uuid": "f66d5403-0d03-4f32-9d50-bb9b86b44cb5"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:53:02.396400 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-05c32562-874d-4f4b-95bc-2aebdbffb93d tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:02.397003 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-05c32562-874d-4f4b-95bc-2aebdbffb93d tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: dff389e3-85df-444f-9afa-4e4acc296656] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:02.404155 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05c32562-874d-4f4b-95bc-2aebdbffb93d tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:02.404850 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05c32562-874d-4f4b-95bc-2aebdbffb93d tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:02.405388 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05c32562-874d-4f4b-95bc-2aebdbffb93d tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:02.405915 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05c32562-874d-4f4b-95bc-2aebdbffb93d tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:02.406538 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-8d7a0b8d-7ffb-439d-9f8a-9bcd1271adcf tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] validate_networks() for [('f66d5403-0d03-4f32-9d50-bb9b86b44cb5', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:53:02.624855 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-05c32562-874d-4f4b-95bc-2aebdbffb93d tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:02.634924 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-05c32562-874d-4f4b-95bc-2aebdbffb93d tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656" status: 200 len: 1319 microversion: 2.1 time: 0.242081 Oct 28 08:53:02.640462 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 709/1430] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:02 2021] GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:53:02.719593 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-d96d7f53-3d19-4444-905a-c3db6ac061f4 req-f2d75ae8-60d4-4545-be71-7f79dea382e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dff389e3-85df-444f-9afa-4e4acc296656", "name": "network-vif-plugged", "status": "completed", "tag": "be638b95-51cb-467e-b571-b524bc986fab"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:53:02.721693 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:53:02.721693 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:53:02.729458 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d96d7f53-3d19-4444-905a-c3db6ac061f4 req-f2d75ae8-60d4-4545-be71-7f79dea382e5 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:02.730908 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d96d7f53-3d19-4444-905a-c3db6ac061f4 req-f2d75ae8-60d4-4545-be71-7f79dea382e5 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:02.743861 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-d96d7f53-3d19-4444-905a-c3db6ac061f4 req-f2d75ae8-60d4-4545-be71-7f79dea382e5 service nova] Creating event network-vif-plugged:be638b95-51cb-467e-b571-b524bc986fab for instance dff389e3-85df-444f-9afa-4e4acc296656 on hv-cinder-81565 Oct 28 08:53:02.750855 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-d96d7f53-3d19-4444-905a-c3db6ac061f4 req-f2d75ae8-60d4-4545-be71-7f79dea382e5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035973 Oct 28 08:53:02.752054 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 710/1431] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:53:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:53:03.069116 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-8d7a0b8d-7ffb-439d-9f8a-9bcd1271adcf tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:53:03.069537 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-8d7a0b8d-7ffb-439d-9f8a-9bcd1271adcf tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:53:03.070008 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-8d7a0b8d-7ffb-439d-9f8a-9bcd1271adcf tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:53:03.070560 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-8d7a0b8d-7ffb-439d-9f8a-9bcd1271adcf tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:53:03.071080 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-8d7a0b8d-7ffb-439d-9f8a-9bcd1271adcf tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:53:03.081297 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d7a0b8d-7ffb-439d-9f8a-9bcd1271adcf tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:03.081740 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d7a0b8d-7ffb-439d-9f8a-9bcd1271adcf tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:03.082566 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d7a0b8d-7ffb-439d-9f8a-9bcd1271adcf tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:03.082998 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d7a0b8d-7ffb-439d-9f8a-9bcd1271adcf tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:03.102746 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-8d7a0b8d-7ffb-439d-9f8a-9bcd1271adcf tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Getting quotas for project a64a3a87a40249f8993dee5bc1950484. Resources: {'instances', 'cores', 'ram'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:53:03.107961 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-8d7a0b8d-7ffb-439d-9f8a-9bcd1271adcf tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Getting quotas for user 1d00d9bbd6f1477eb0998236b921007e and project a64a3a87a40249f8993dee5bc1950484. Resources: {'instances', 'cores', 'ram'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:53:03.119822 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8d7a0b8d-7ffb-439d-9f8a-9bcd1271adcf tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:53:03.123083 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8d7a0b8d-7ffb-439d-9f8a-9bcd1271adcf tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9864ce53-d02e-4fb0-beaa-d890a25ec6ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:53:03.173291 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8d7a0b8d-7ffb-439d-9f8a-9bcd1271adcf tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.830420 Oct 28 08:53:03.173968 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 722/1432] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Oct 28 08:53:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:53:03.186680 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a47694d9-8809-4c77-a765-db994e3c4f8e tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:03.187511 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a47694d9-8809-4c77-a765-db994e3c4f8e tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:03.244865 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-a47694d9-8809-4c77-a765-db994e3c4f8e tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:03.253260 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a47694d9-8809-4c77-a765-db994e3c4f8e tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1258 microversion: 2.1 time: 0.071552 Oct 28 08:53:03.253854 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 711/1433] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:03 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:03.653859 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6053e8ba-226a-42d7-b58c-7f75f0d5b7fb tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:03.654524 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6053e8ba-226a-42d7-b58c-7f75f0d5b7fb tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: dff389e3-85df-444f-9afa-4e4acc296656] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:03.661484 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6053e8ba-226a-42d7-b58c-7f75f0d5b7fb tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:03.662000 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6053e8ba-226a-42d7-b58c-7f75f0d5b7fb tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:03.662935 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6053e8ba-226a-42d7-b58c-7f75f0d5b7fb tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:03.663373 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6053e8ba-226a-42d7-b58c-7f75f0d5b7fb tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:03.806145 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-6053e8ba-226a-42d7-b58c-7f75f0d5b7fb tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:03.814411 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6053e8ba-226a-42d7-b58c-7f75f0d5b7fb tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656" status: 200 len: 1319 microversion: 2.1 time: 0.164711 Oct 28 08:53:03.815275 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 723/1434] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:03 2021] GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:04.271353 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-918606e4-e116-4ab1-ae66-5f51ce174761 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:04.271992 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-918606e4-e116-4ab1-ae66-5f51ce174761 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:04.279912 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-918606e4-e116-4ab1-ae66-5f51ce174761 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:04.280646 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-918606e4-e116-4ab1-ae66-5f51ce174761 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:04.281430 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-918606e4-e116-4ab1-ae66-5f51ce174761 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:04.281866 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-918606e4-e116-4ab1-ae66-5f51ce174761 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:04.343512 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-918606e4-e116-4ab1-ae66-5f51ce174761 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:04.351637 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-918606e4-e116-4ab1-ae66-5f51ce174761 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1310 microversion: 2.1 time: 0.084161 Oct 28 08:53:04.352506 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 712/1435] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:04 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:53:04.831694 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b8160d70-1744-4b3d-89ba-cb4353a36bf8 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:04.832331 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b8160d70-1744-4b3d-89ba-cb4353a36bf8 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: dff389e3-85df-444f-9afa-4e4acc296656] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:04.839034 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8160d70-1744-4b3d-89ba-cb4353a36bf8 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:04.840003 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8160d70-1744-4b3d-89ba-cb4353a36bf8 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:04.840879 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8160d70-1744-4b3d-89ba-cb4353a36bf8 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:04.841369 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8160d70-1744-4b3d-89ba-cb4353a36bf8 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:05.083995 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-b8160d70-1744-4b3d-89ba-cb4353a36bf8 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:05.099782 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b8160d70-1744-4b3d-89ba-cb4353a36bf8 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656" status: 200 len: 1508 microversion: 2.1 time: 0.271735 Oct 28 08:53:05.100375 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 724/1436] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:04 2021] GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656 => generated 1508 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:05.118295 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e7bfd856-aefc-4d5a-8d15-c0c6d5f25071 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06b50d43-4606-4871-b508-319bfb5b4cc8", "device": "/dev/sdb"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:53:05.120317 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e7bfd856-aefc-4d5a-8d15-c0c6d5f25071 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: dff389e3-85df-444f-9afa-4e4acc296656] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:05.127449 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7bfd856-aefc-4d5a-8d15-c0c6d5f25071 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:05.128204 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7bfd856-aefc-4d5a-8d15-c0c6d5f25071 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:05.129170 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7bfd856-aefc-4d5a-8d15-c0c6d5f25071 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:05.129775 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7bfd856-aefc-4d5a-8d15-c0c6d5f25071 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:05.373396 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1d008fd3-ce18-4890-9640-9bbb352fb177 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:05.374459 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1d008fd3-ce18-4890-9640-9bbb352fb177 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:05.390036 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d008fd3-ce18-4890-9640-9bbb352fb177 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:05.391232 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d008fd3-ce18-4890-9640-9bbb352fb177 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:05.393248 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d008fd3-ce18-4890-9640-9bbb352fb177 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:05.394272 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d008fd3-ce18-4890-9640-9bbb352fb177 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:05.478468 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1d008fd3-ce18-4890-9640-9bbb352fb177 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:05.497383 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1d008fd3-ce18-4890-9640-9bbb352fb177 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1316 microversion: 2.1 time: 0.130301 Oct 28 08:53:05.510568 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 725/1437] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:05 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1316 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:06.519992 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ba33eaa9-7378-49be-b281-adc947b1a5a5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:06.520976 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ba33eaa9-7378-49be-b281-adc947b1a5a5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:06.533166 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba33eaa9-7378-49be-b281-adc947b1a5a5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:06.533864 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba33eaa9-7378-49be-b281-adc947b1a5a5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:06.535154 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba33eaa9-7378-49be-b281-adc947b1a5a5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:06.535835 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba33eaa9-7378-49be-b281-adc947b1a5a5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:06.709383 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-ba33eaa9-7378-49be-b281-adc947b1a5a5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:06.719692 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ba33eaa9-7378-49be-b281-adc947b1a5a5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1358 microversion: 2.1 time: 0.205785 Oct 28 08:53:06.720689 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 726/1438] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:06 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:53:07.737627 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0b4f6f37-6d64-4a84-a4ba-26bb32a4988b tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:07.738354 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0b4f6f37-6d64-4a84-a4ba-26bb32a4988b tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:07.745229 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b4f6f37-6d64-4a84-a4ba-26bb32a4988b tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:07.746891 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b4f6f37-6d64-4a84-a4ba-26bb32a4988b tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:07.747715 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b4f6f37-6d64-4a84-a4ba-26bb32a4988b tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:07.748309 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b4f6f37-6d64-4a84-a4ba-26bb32a4988b tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:07.894472 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-0b4f6f37-6d64-4a84-a4ba-26bb32a4988b tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:07.905425 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0b4f6f37-6d64-4a84-a4ba-26bb32a4988b tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1358 microversion: 2.1 time: 0.171569 Oct 28 08:53:07.906439 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 727/1439] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:07 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:53:08.928246 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-93d7082a-5f14-4d61-82f8-19fd778c51c9 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:08.929046 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-93d7082a-5f14-4d61-82f8-19fd778c51c9 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:08.936213 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-93d7082a-5f14-4d61-82f8-19fd778c51c9 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:08.936741 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-93d7082a-5f14-4d61-82f8-19fd778c51c9 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:08.937607 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-93d7082a-5f14-4d61-82f8-19fd778c51c9 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:08.938039 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-93d7082a-5f14-4d61-82f8-19fd778c51c9 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:09.089170 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-93d7082a-5f14-4d61-82f8-19fd778c51c9 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:09.097931 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-93d7082a-5f14-4d61-82f8-19fd778c51c9 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1358 microversion: 2.1 time: 0.177326 Oct 28 08:53:09.098776 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 728/1440] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:08 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:53:10.117085 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-670fc257-dc7a-496a-b858-eabe02f1b59c tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:10.117773 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-670fc257-dc7a-496a-b858-eabe02f1b59c tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:10.124215 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-670fc257-dc7a-496a-b858-eabe02f1b59c tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:10.124655 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-670fc257-dc7a-496a-b858-eabe02f1b59c tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:10.125456 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-670fc257-dc7a-496a-b858-eabe02f1b59c tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:10.125883 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-670fc257-dc7a-496a-b858-eabe02f1b59c tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:10.264207 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-670fc257-dc7a-496a-b858-eabe02f1b59c tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:10.271968 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-670fc257-dc7a-496a-b858-eabe02f1b59c tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1358 microversion: 2.1 time: 0.159709 Oct 28 08:53:10.272580 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 729/1441] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:10 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:53:11.290233 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-99ec330a-7700-4a53-a813-2f29292f05c3 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:11.291355 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-99ec330a-7700-4a53-a813-2f29292f05c3 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:11.299411 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99ec330a-7700-4a53-a813-2f29292f05c3 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:11.299846 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99ec330a-7700-4a53-a813-2f29292f05c3 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:11.300634 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99ec330a-7700-4a53-a813-2f29292f05c3 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:11.301097 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99ec330a-7700-4a53-a813-2f29292f05c3 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:11.461160 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-99ec330a-7700-4a53-a813-2f29292f05c3 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:11.469510 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-99ec330a-7700-4a53-a813-2f29292f05c3 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1358 microversion: 2.1 time: 0.182995 Oct 28 08:53:11.470519 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 730/1442] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:11 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:53:12.486723 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e3126333-57e4-4f20-b3bb-baa21e1c5cb2 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:12.487460 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e3126333-57e4-4f20-b3bb-baa21e1c5cb2 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:12.493844 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3126333-57e4-4f20-b3bb-baa21e1c5cb2 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:12.494279 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3126333-57e4-4f20-b3bb-baa21e1c5cb2 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:12.495131 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3126333-57e4-4f20-b3bb-baa21e1c5cb2 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:12.496097 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3126333-57e4-4f20-b3bb-baa21e1c5cb2 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:12.638361 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-e3126333-57e4-4f20-b3bb-baa21e1c5cb2 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:12.646369 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e3126333-57e4-4f20-b3bb-baa21e1c5cb2 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1358 microversion: 2.1 time: 0.163353 Oct 28 08:53:12.646986 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 731/1443] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:12 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:53:13.663584 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4098c6d8-0e7a-4840-aae9-0c759fe1b057 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:13.664544 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4098c6d8-0e7a-4840-aae9-0c759fe1b057 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:13.671955 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4098c6d8-0e7a-4840-aae9-0c759fe1b057 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:13.672397 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4098c6d8-0e7a-4840-aae9-0c759fe1b057 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:13.673426 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4098c6d8-0e7a-4840-aae9-0c759fe1b057 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:13.673908 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4098c6d8-0e7a-4840-aae9-0c759fe1b057 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:13.836186 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-4098c6d8-0e7a-4840-aae9-0c759fe1b057 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:13.844979 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4098c6d8-0e7a-4840-aae9-0c759fe1b057 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1358 microversion: 2.1 time: 0.185161 Oct 28 08:53:13.845566 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 732/1444] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:13 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:53:14.862547 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-91e004af-f705-4c62-a091-c5318357712a tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:14.863741 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-91e004af-f705-4c62-a091-c5318357712a tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:14.872503 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91e004af-f705-4c62-a091-c5318357712a tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:14.872503 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91e004af-f705-4c62-a091-c5318357712a tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:14.872944 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91e004af-f705-4c62-a091-c5318357712a tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:14.873384 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91e004af-f705-4c62-a091-c5318357712a tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:15.006877 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-91e004af-f705-4c62-a091-c5318357712a tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:15.015110 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-91e004af-f705-4c62-a091-c5318357712a tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1358 microversion: 2.1 time: 0.157079 Oct 28 08:53:15.015686 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 733/1445] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:14 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:53:16.033154 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b1201670-850d-4b0a-95b9-dc6a45a34f1f tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:16.033924 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b1201670-850d-4b0a-95b9-dc6a45a34f1f tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:16.040259 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1201670-850d-4b0a-95b9-dc6a45a34f1f tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:16.040705 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1201670-850d-4b0a-95b9-dc6a45a34f1f tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:16.041471 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1201670-850d-4b0a-95b9-dc6a45a34f1f tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:16.041898 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1201670-850d-4b0a-95b9-dc6a45a34f1f tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:16.164165 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-b1201670-850d-4b0a-95b9-dc6a45a34f1f tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:16.172482 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b1201670-850d-4b0a-95b9-dc6a45a34f1f tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1358 microversion: 2.1 time: 0.143102 Oct 28 08:53:16.173053 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 734/1446] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:16 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1358 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:53:17.190320 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1167ee63-841f-4f04-bc5c-17f2e1025417 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:17.191035 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1167ee63-841f-4f04-bc5c-17f2e1025417 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:17.197227 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1167ee63-841f-4f04-bc5c-17f2e1025417 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:17.197729 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1167ee63-841f-4f04-bc5c-17f2e1025417 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:17.199354 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1167ee63-841f-4f04-bc5c-17f2e1025417 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:17.199811 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1167ee63-841f-4f04-bc5c-17f2e1025417 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:17.323102 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1167ee63-841f-4f04-bc5c-17f2e1025417 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:17.330751 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1167ee63-841f-4f04-bc5c-17f2e1025417 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1358 microversion: 2.1 time: 0.144243 Oct 28 08:53:17.331313 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 735/1447] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:17 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:17.609728 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e7bfd856-aefc-4d5a-8d15-c0c6d5f25071 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "POST /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.494663 Oct 28 08:53:17.611294 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 713/1448] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Oct 28 08:53:05 2021] POST /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656/os-volume_attachments => generated 194 bytes in 12498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:53:18.347787 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9eb24efd-6c7f-4ea1-8fcf-d73f25e6b855 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:18.349356 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9eb24efd-6c7f-4ea1-8fcf-d73f25e6b855 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:18.355061 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9eb24efd-6c7f-4ea1-8fcf-d73f25e6b855 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:18.355617 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9eb24efd-6c7f-4ea1-8fcf-d73f25e6b855 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:18.356472 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9eb24efd-6c7f-4ea1-8fcf-d73f25e6b855 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:18.356978 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9eb24efd-6c7f-4ea1-8fcf-d73f25e6b855 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:18.614307 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-4e37d01a-43cb-4983-a0d5-4e365de10dfe req-6294b358-98d5-4ce1-89dd-3d48f30d38b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50944263-608b-4801-b378-689b85093143", "tag": "6a1f38b0-f1d6-4d99-8efa-36e104032ea5"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:53:18.618124 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:53:18.618124 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:53:18.627203 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-4e37d01a-43cb-4983-a0d5-4e365de10dfe req-6294b358-98d5-4ce1-89dd-3d48f30d38b4 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:18.627638 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-4e37d01a-43cb-4983-a0d5-4e365de10dfe req-6294b358-98d5-4ce1-89dd-3d48f30d38b4 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:18.640385 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-4e37d01a-43cb-4983-a0d5-4e365de10dfe req-6294b358-98d5-4ce1-89dd-3d48f30d38b4 service nova] Creating event network-changed:6a1f38b0-f1d6-4d99-8efa-36e104032ea5 for instance 50944263-608b-4801-b378-689b85093143 on hv-cinder-81565 Oct 28 08:53:18.645919 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-4e37d01a-43cb-4983-a0d5-4e365de10dfe req-6294b358-98d5-4ce1-89dd-3d48f30d38b4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038758 Oct 28 08:53:18.646635 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 714/1449] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:53:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:53:18.703359 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-9eb24efd-6c7f-4ea1-8fcf-d73f25e6b855 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:18.712264 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9eb24efd-6c7f-4ea1-8fcf-d73f25e6b855 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1358 microversion: 2.1 time: 0.368065 Oct 28 08:53:18.725830 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 736/1450] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:18 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1358 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:19.741217 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-00d1d83e-4d51-4d62-b4e5-0892da1e64d5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:19.742205 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-00d1d83e-4d51-4d62-b4e5-0892da1e64d5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:19.751319 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00d1d83e-4d51-4d62-b4e5-0892da1e64d5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:19.751762 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00d1d83e-4d51-4d62-b4e5-0892da1e64d5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:19.752643 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00d1d83e-4d51-4d62-b4e5-0892da1e64d5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:19.753114 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00d1d83e-4d51-4d62-b4e5-0892da1e64d5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:20.015146 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-00d1d83e-4d51-4d62-b4e5-0892da1e64d5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:20.028181 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-00d1d83e-4d51-4d62-b4e5-0892da1e64d5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1358 microversion: 2.1 time: 0.291721 Oct 28 08:53:20.028788 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 715/1451] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:19 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1358 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:21.045403 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-724e1c6a-4fd7-46b4-a917-1676f5b8fba6 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:21.046046 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-724e1c6a-4fd7-46b4-a917-1676f5b8fba6 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:21.052479 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-724e1c6a-4fd7-46b4-a917-1676f5b8fba6 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:21.052928 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-724e1c6a-4fd7-46b4-a917-1676f5b8fba6 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:21.053708 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-724e1c6a-4fd7-46b4-a917-1676f5b8fba6 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:21.054139 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-724e1c6a-4fd7-46b4-a917-1676f5b8fba6 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:21.189728 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-724e1c6a-4fd7-46b4-a917-1676f5b8fba6 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:21.197343 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-724e1c6a-4fd7-46b4-a917-1676f5b8fba6 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1358 microversion: 2.1 time: 0.155699 Oct 28 08:53:21.197930 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 737/1452] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:21 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:22.215911 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-56b31cb5-9711-4f91-96eb-a0d3f669443b tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:22.216540 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-56b31cb5-9711-4f91-96eb-a0d3f669443b tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:22.222968 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56b31cb5-9711-4f91-96eb-a0d3f669443b tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:22.223418 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56b31cb5-9711-4f91-96eb-a0d3f669443b tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:22.224192 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56b31cb5-9711-4f91-96eb-a0d3f669443b tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:22.224652 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56b31cb5-9711-4f91-96eb-a0d3f669443b tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:22.361186 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-56b31cb5-9711-4f91-96eb-a0d3f669443b tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:22.368812 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-56b31cb5-9711-4f91-96eb-a0d3f669443b tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1358 microversion: 2.1 time: 0.157143 Oct 28 08:53:22.369379 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 716/1453] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:22 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:23.386310 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7f9412b7-c16a-4298-94f4-badd61006531 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:23.386979 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7f9412b7-c16a-4298-94f4-badd61006531 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:23.393542 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f9412b7-c16a-4298-94f4-badd61006531 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:23.394015 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f9412b7-c16a-4298-94f4-badd61006531 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:23.394850 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f9412b7-c16a-4298-94f4-badd61006531 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:23.395275 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f9412b7-c16a-4298-94f4-badd61006531 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:23.536060 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-7f9412b7-c16a-4298-94f4-badd61006531 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:23.554309 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7f9412b7-c16a-4298-94f4-badd61006531 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1358 microversion: 2.1 time: 0.171711 Oct 28 08:53:23.554929 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 738/1454] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:23 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:24.580761 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-51001363-47f5-4ca1-ae89-4b1aae1a5524 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:24.581383 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-51001363-47f5-4ca1-ae89-4b1aae1a5524 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:24.587984 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51001363-47f5-4ca1-ae89-4b1aae1a5524 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:24.588434 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51001363-47f5-4ca1-ae89-4b1aae1a5524 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:24.589525 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51001363-47f5-4ca1-ae89-4b1aae1a5524 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:24.590087 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51001363-47f5-4ca1-ae89-4b1aae1a5524 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:24.733554 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-51001363-47f5-4ca1-ae89-4b1aae1a5524 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:24.741321 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-51001363-47f5-4ca1-ae89-4b1aae1a5524 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1358 microversion: 2.1 time: 0.164346 Oct 28 08:53:24.741906 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 717/1455] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:24 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:53:24.834066 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-c428ee26-24d8-4c19-8684-403717edb6ef req-14a9fa5e-c807-4aac-b13e-61322a9ac74e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50944263-608b-4801-b378-689b85093143", "name": "network-vif-plugged", "status": "completed", "tag": "6a1f38b0-f1d6-4d99-8efa-36e104032ea5"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:53:24.835820 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:53:24.835820 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:53:24.844599 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c428ee26-24d8-4c19-8684-403717edb6ef req-14a9fa5e-c807-4aac-b13e-61322a9ac74e service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:24.845119 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c428ee26-24d8-4c19-8684-403717edb6ef req-14a9fa5e-c807-4aac-b13e-61322a9ac74e service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:24.862135 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-c428ee26-24d8-4c19-8684-403717edb6ef req-14a9fa5e-c807-4aac-b13e-61322a9ac74e service nova] Creating event network-vif-plugged:6a1f38b0-f1d6-4d99-8efa-36e104032ea5 for instance 50944263-608b-4801-b378-689b85093143 on hv-cinder-81565 Oct 28 08:53:24.872427 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-c428ee26-24d8-4c19-8684-403717edb6ef req-14a9fa5e-c807-4aac-b13e-61322a9ac74e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040384 Oct 28 08:53:24.873774 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 739/1456] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:53:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:53:25.759448 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c62a604b-80ca-4724-be93-f67b5f0e4b14 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:25.760128 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c62a604b-80ca-4724-be93-f67b5f0e4b14 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:25.767464 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c62a604b-80ca-4724-be93-f67b5f0e4b14 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:25.767908 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c62a604b-80ca-4724-be93-f67b5f0e4b14 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:25.768701 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c62a604b-80ca-4724-be93-f67b5f0e4b14 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:25.769136 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c62a604b-80ca-4724-be93-f67b5f0e4b14 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:25.907716 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c62a604b-80ca-4724-be93-f67b5f0e4b14 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:25.921259 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c62a604b-80ca-4724-be93-f67b5f0e4b14 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1358 microversion: 2.1 time: 0.165097 Oct 28 08:53:25.922232 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 718/1457] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:25 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:26.940005 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-74b242e6-bee1-41e7-98ab-666b792f95f5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:26.940707 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-74b242e6-bee1-41e7-98ab-666b792f95f5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:26.947656 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74b242e6-bee1-41e7-98ab-666b792f95f5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:26.948100 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74b242e6-bee1-41e7-98ab-666b792f95f5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:26.949471 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74b242e6-bee1-41e7-98ab-666b792f95f5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:26.949902 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74b242e6-bee1-41e7-98ab-666b792f95f5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:27.104218 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-74b242e6-bee1-41e7-98ab-666b792f95f5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:27.111927 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-74b242e6-bee1-41e7-98ab-666b792f95f5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1358 microversion: 2.1 time: 0.176046 Oct 28 08:53:27.112505 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 740/1458] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:26 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:28.129336 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-90e2c145-da2e-41a9-b959-85e3ce84d1e8 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:28.129937 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-90e2c145-da2e-41a9-b959-85e3ce84d1e8 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:28.137202 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90e2c145-da2e-41a9-b959-85e3ce84d1e8 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:28.137650 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90e2c145-da2e-41a9-b959-85e3ce84d1e8 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:28.138527 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90e2c145-da2e-41a9-b959-85e3ce84d1e8 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:28.139055 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90e2c145-da2e-41a9-b959-85e3ce84d1e8 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:28.273154 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-90e2c145-da2e-41a9-b959-85e3ce84d1e8 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:28.281633 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-90e2c145-da2e-41a9-b959-85e3ce84d1e8 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1358 microversion: 2.1 time: 0.155878 Oct 28 08:53:28.282221 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 719/1459] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:28 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:29.298742 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c9c39024-884b-4a9a-9568-20965f483fd8 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:29.299351 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c9c39024-884b-4a9a-9568-20965f483fd8 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:29.305784 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9c39024-884b-4a9a-9568-20965f483fd8 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:29.306231 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9c39024-884b-4a9a-9568-20965f483fd8 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:29.307048 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9c39024-884b-4a9a-9568-20965f483fd8 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:29.307472 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9c39024-884b-4a9a-9568-20965f483fd8 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:29.440288 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-c9c39024-884b-4a9a-9568-20965f483fd8 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:29.447889 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c9c39024-884b-4a9a-9568-20965f483fd8 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1358 microversion: 2.1 time: 0.152879 Oct 28 08:53:29.449054 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 741/1460] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:29 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:30.466617 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-82daca17-9a73-422e-a4c6-5a86e8071f0a tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:30.467311 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-82daca17-9a73-422e-a4c6-5a86e8071f0a tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:30.473708 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82daca17-9a73-422e-a4c6-5a86e8071f0a tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:30.474155 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82daca17-9a73-422e-a4c6-5a86e8071f0a tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:30.474972 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82daca17-9a73-422e-a4c6-5a86e8071f0a tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:30.475402 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82daca17-9a73-422e-a4c6-5a86e8071f0a tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:30.607824 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-82daca17-9a73-422e-a4c6-5a86e8071f0a tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:30.615423 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-82daca17-9a73-422e-a4c6-5a86e8071f0a tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1358 microversion: 2.1 time: 0.153339 Oct 28 08:53:30.615915 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 720/1461] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:30 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:31.641610 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2d84f5a5-5bd5-48c2-8549-6e5619ff2d69 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:31.642853 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2d84f5a5-5bd5-48c2-8549-6e5619ff2d69 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:31.651804 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d84f5a5-5bd5-48c2-8549-6e5619ff2d69 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:31.652336 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d84f5a5-5bd5-48c2-8549-6e5619ff2d69 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:31.653116 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d84f5a5-5bd5-48c2-8549-6e5619ff2d69 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:31.653586 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d84f5a5-5bd5-48c2-8549-6e5619ff2d69 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:31.801723 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-2d84f5a5-5bd5-48c2-8549-6e5619ff2d69 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:31.816312 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2d84f5a5-5bd5-48c2-8549-6e5619ff2d69 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1548 microversion: 2.1 time: 0.180504 Oct 28 08:53:31.817374 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 742/1462] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:31 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1548 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:31.835281 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-64ab2348-96e1-4b54-b0a9-5bdf5d90e04e tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:31.836225 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-64ab2348-96e1-4b54-b0a9-5bdf5d90e04e tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:31.843607 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64ab2348-96e1-4b54-b0a9-5bdf5d90e04e tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:31.844058 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64ab2348-96e1-4b54-b0a9-5bdf5d90e04e tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:31.844835 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64ab2348-96e1-4b54-b0a9-5bdf5d90e04e tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:31.845267 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64ab2348-96e1-4b54-b0a9-5bdf5d90e04e tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:31.982656 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-64ab2348-96e1-4b54-b0a9-5bdf5d90e04e tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:31.990412 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-64ab2348-96e1-4b54-b0a9-5bdf5d90e04e tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1548 microversion: 2.1 time: 0.160063 Oct 28 08:53:31.991034 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 721/1463] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:31 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:53:32.006817 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d18e88ff-e5e1-4694-938e-11d793d13807 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:32.010249 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:53:32.010249 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:53:32.011779 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-d18e88ff-e5e1-4694-938e-11d793d13807 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:32.012624 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d18e88ff-e5e1-4694-938e-11d793d13807 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Searching by: {'deleted': False, 'project_id': 'a64a3a87a40249f8993dee5bc1950484'} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:2905}} Oct 28 08:53:32.019447 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d18e88ff-e5e1-4694-938e-11d793d13807 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:32.019890 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d18e88ff-e5e1-4694-938e-11d793d13807 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:32.020677 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d18e88ff-e5e1-4694-938e-11d793d13807 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:32.021130 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d18e88ff-e5e1-4694-938e-11d793d13807 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:32.114025 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.multi_cell_list [None req-d18e88ff-e5e1-4694-938e-11d793d13807 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122257) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Oct 28 08:53:32.220605 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d18e88ff-e5e1-4694-938e-11d793d13807 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.217333 Oct 28 08:53:32.221181 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 743/1464] 10.222.0.76 () {58 vars in 1124 bytes} [Thu Oct 28 08:53:32 2021] GET /compute/v2.1/servers => generated 343 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:53:32.232103 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c54e84b5-a403-402e-b58d-55a945cf8286 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:32.232764 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c54e84b5-a403-402e-b58d-55a945cf8286 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:32.239632 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c54e84b5-a403-402e-b58d-55a945cf8286 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:32.240077 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c54e84b5-a403-402e-b58d-55a945cf8286 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:32.240855 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c54e84b5-a403-402e-b58d-55a945cf8286 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:32.241281 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c54e84b5-a403-402e-b58d-55a945cf8286 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:32.373724 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c54e84b5-a403-402e-b58d-55a945cf8286 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:32.381319 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c54e84b5-a403-402e-b58d-55a945cf8286 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1548 microversion: 2.1 time: 0.153704 Oct 28 08:53:32.381881 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 722/1465] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:32 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:37.158970 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8aad0fba-d5a1-4c3d-b1fd-93233e0efac3 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "22957ac0-04ed-4101-b5ef-240898f4130a"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:53:37.160015 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8aad0fba-d5a1-4c3d-b1fd-93233e0efac3 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:37.166970 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8aad0fba-d5a1-4c3d-b1fd-93233e0efac3 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:37.168410 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8aad0fba-d5a1-4c3d-b1fd-93233e0efac3 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:37.169419 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8aad0fba-d5a1-4c3d-b1fd-93233e0efac3 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:37.169957 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8aad0fba-d5a1-4c3d-b1fd-93233e0efac3 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:37.452061 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8aad0fba-d5a1-4c3d-b1fd-93233e0efac3 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "POST /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289098 Oct 28 08:53:37.452061 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 744/1466] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Oct 28 08:53:37 2021] POST /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:53:40.136406 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0fb6e35b-5971-4f0f-9450-b030738f016e tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:40.136964 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0fb6e35b-5971-4f0f-9450-b030738f016e tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: dff389e3-85df-444f-9afa-4e4acc296656] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:40.143334 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0fb6e35b-5971-4f0f-9450-b030738f016e tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:40.143777 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0fb6e35b-5971-4f0f-9450-b030738f016e tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:40.144559 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0fb6e35b-5971-4f0f-9450-b030738f016e tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:40.144983 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0fb6e35b-5971-4f0f-9450-b030738f016e tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:40.231366 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-0fb6e35b-5971-4f0f-9450-b030738f016e tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lazy-loading 'services' on Instance uuid dff389e3-85df-444f-9afa-4e4acc296656 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:53:40.308710 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0fb6e35b-5971-4f0f-9450-b030738f016e tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "DELETE /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656/os-volume_attachments/06b50d43-4606-4871-b508-319bfb5b4cc8" status: 202 len: 0 microversion: 2.1 time: 0.176287 Oct 28 08:53:40.309325 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 723/1467] 10.222.0.76 () {58 vars in 1415 bytes} [Thu Oct 28 08:53:40 2021] DELETE /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656/os-volume_attachments/06b50d43-4606-4871-b508-319bfb5b4cc8 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:53:45.027493 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eb387608-a518-4c29-a83f-9454ffdc6371 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:45.028196 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eb387608-a518-4c29-a83f-9454ffdc6371 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:45.035316 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb387608-a518-4c29-a83f-9454ffdc6371 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:45.035752 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb387608-a518-4c29-a83f-9454ffdc6371 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:45.036536 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb387608-a518-4c29-a83f-9454ffdc6371 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:45.036954 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb387608-a518-4c29-a83f-9454ffdc6371 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:45.178668 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-eb387608-a518-4c29-a83f-9454ffdc6371 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:45.187680 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eb387608-a518-4c29-a83f-9454ffdc6371 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1594 microversion: 2.1 time: 0.164964 Oct 28 08:53:45.188226 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 745/1468] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:45 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1594 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:45.643230 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5beb402c-6f71-4316-98b1-9f78a7411f1a tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:45.643913 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5beb402c-6f71-4316-98b1-9f78a7411f1a tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: dff389e3-85df-444f-9afa-4e4acc296656] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:45.650387 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5beb402c-6f71-4316-98b1-9f78a7411f1a tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:45.650879 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5beb402c-6f71-4316-98b1-9f78a7411f1a tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:45.652192 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5beb402c-6f71-4316-98b1-9f78a7411f1a tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:45.652622 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5beb402c-6f71-4316-98b1-9f78a7411f1a tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:45.678782 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5beb402c-6f71-4316-98b1-9f78a7411f1a tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: dff389e3-85df-444f-9afa-4e4acc296656] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:53:45.764321 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5beb402c-6f71-4316-98b1-9f78a7411f1a tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "DELETE /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656" status: 204 len: 0 microversion: 2.1 time: 0.124272 Oct 28 08:53:45.765453 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 724/1469] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Oct 28 08:53:45 2021] DELETE /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:53:45.775671 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3dfe7c65-05dd-4063-b115-6602fe3c0be2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:45.775671 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3dfe7c65-05dd-4063-b115-6602fe3c0be2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: dff389e3-85df-444f-9afa-4e4acc296656] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:45.782241 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3dfe7c65-05dd-4063-b115-6602fe3c0be2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:45.783018 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3dfe7c65-05dd-4063-b115-6602fe3c0be2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:45.784019 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3dfe7c65-05dd-4063-b115-6602fe3c0be2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:45.784702 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3dfe7c65-05dd-4063-b115-6602fe3c0be2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:46.048336 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3dfe7c65-05dd-4063-b115-6602fe3c0be2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:46.056164 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3dfe7c65-05dd-4063-b115-6602fe3c0be2 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656" status: 200 len: 1514 microversion: 2.1 time: 0.285843 Oct 28 08:53:46.056696 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 746/1470] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:45 2021] GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656 => generated 1514 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:53:47.037707 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-cafd5481-a2bd-4e46-af2a-6c37bda6188b req-c69f4e22-bda7-4902-83a8-f393d7b07e4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50944263-608b-4801-b378-689b85093143", "tag": "6a1f38b0-f1d6-4d99-8efa-36e104032ea5"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:53:47.039419 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:53:47.039419 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:53:47.047679 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-cafd5481-a2bd-4e46-af2a-6c37bda6188b req-c69f4e22-bda7-4902-83a8-f393d7b07e4c service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:47.048122 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-cafd5481-a2bd-4e46-af2a-6c37bda6188b req-c69f4e22-bda7-4902-83a8-f393d7b07e4c service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:47.061169 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-cafd5481-a2bd-4e46-af2a-6c37bda6188b req-c69f4e22-bda7-4902-83a8-f393d7b07e4c service nova] Creating event network-changed:6a1f38b0-f1d6-4d99-8efa-36e104032ea5 for instance 50944263-608b-4801-b378-689b85093143 on hv-cinder-81565 Oct 28 08:53:47.066475 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-cafd5481-a2bd-4e46-af2a-6c37bda6188b req-c69f4e22-bda7-4902-83a8-f393d7b07e4c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034046 Oct 28 08:53:47.071594 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 725/1471] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:53:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:53:47.074420 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-427fb799-9627-4c89-9f13-820e0592b966 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:47.075633 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-427fb799-9627-4c89-9f13-820e0592b966 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: dff389e3-85df-444f-9afa-4e4acc296656] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:47.083590 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-427fb799-9627-4c89-9f13-820e0592b966 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:47.084334 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-427fb799-9627-4c89-9f13-820e0592b966 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:47.085472 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-427fb799-9627-4c89-9f13-820e0592b966 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:47.086418 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-427fb799-9627-4c89-9f13-820e0592b966 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:47.294431 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-427fb799-9627-4c89-9f13-820e0592b966 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:47.310480 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-427fb799-9627-4c89-9f13-820e0592b966 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656" status: 200 len: 1514 microversion: 2.1 time: 0.239537 Oct 28 08:53:47.311916 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 747/1472] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:47 2021] GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656 => generated 1514 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:48.331759 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-592fcb58-0474-4833-89d9-08d7e04a41a5 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:48.333373 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-592fcb58-0474-4833-89d9-08d7e04a41a5 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: dff389e3-85df-444f-9afa-4e4acc296656] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:48.342034 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-592fcb58-0474-4833-89d9-08d7e04a41a5 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:48.342668 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-592fcb58-0474-4833-89d9-08d7e04a41a5 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:48.343596 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-592fcb58-0474-4833-89d9-08d7e04a41a5 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:48.344129 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-592fcb58-0474-4833-89d9-08d7e04a41a5 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:48.622896 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a1ed8336-d8f3-41db-95c8-5e9d25cf6185 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1822537556"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:53:48.623670 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a1ed8336-d8f3-41db-95c8-5e9d25cf6185 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:48.630118 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1ed8336-d8f3-41db-95c8-5e9d25cf6185 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:48.630711 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1ed8336-d8f3-41db-95c8-5e9d25cf6185 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:48.631485 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1ed8336-d8f3-41db-95c8-5e9d25cf6185 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:48.631908 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1ed8336-d8f3-41db-95c8-5e9d25cf6185 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:48.658842 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-592fcb58-0474-4833-89d9-08d7e04a41a5 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca3422951ef4ccc8f40838ba2532bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9c1891789491bbcae9bca7f8654f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:48.666465 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-592fcb58-0474-4833-89d9-08d7e04a41a5 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656" status: 200 len: 1514 microversion: 2.1 time: 0.341702 Oct 28 08:53:48.667130 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 726/1473] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:48 2021] GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656 => generated 1514 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:48.835339 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.network.security_group_api [None req-a1ed8336-d8f3-41db-95c8-5e9d25cf6185 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Adding security group d957e04d-9d81-48e7-ae44-16c6740f0129 to port 6a1f38b0-f1d6-4d99-8efa-36e104032ea5 Oct 28 08:53:49.085058 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-0385f06d-9192-4f82-a081-c33fbb636ee7 req-ecf09b89-13b9-4b96-ba28-23269b8dd694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dff389e3-85df-444f-9afa-4e4acc296656", "name": "network-vif-deleted", "tag": "be638b95-51cb-467e-b571-b524bc986fab"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:53:49.086879 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:53:49.086879 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:53:49.094784 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0385f06d-9192-4f82-a081-c33fbb636ee7 req-ecf09b89-13b9-4b96-ba28-23269b8dd694 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:49.095518 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0385f06d-9192-4f82-a081-c33fbb636ee7 req-ecf09b89-13b9-4b96-ba28-23269b8dd694 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:49.111470 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-0385f06d-9192-4f82-a081-c33fbb636ee7 req-ecf09b89-13b9-4b96-ba28-23269b8dd694 service nova] Creating event network-vif-deleted:be638b95-51cb-467e-b571-b524bc986fab for instance dff389e3-85df-444f-9afa-4e4acc296656 on hv-cinder-81565 Oct 28 08:53:49.117670 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-0385f06d-9192-4f82-a081-c33fbb636ee7 req-ecf09b89-13b9-4b96-ba28-23269b8dd694 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036030 Oct 28 08:53:49.118304 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 727/1474] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:53:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:53:49.484983 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a1ed8336-d8f3-41db-95c8-5e9d25cf6185 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "POST /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143/action" status: 202 len: 0 microversion: 2.1 time: 0.866522 Oct 28 08:53:49.487444 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 748/1475] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:53:48 2021] POST /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143/action => generated 0 bytes in 870 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:53:49.501810 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a7517371-bf02-4603-a045-20733a214f78 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:49.503910 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a7517371-bf02-4603-a045-20733a214f78 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:49.516368 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7517371-bf02-4603-a045-20733a214f78 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:49.517377 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7517371-bf02-4603-a045-20733a214f78 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:49.518488 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7517371-bf02-4603-a045-20733a214f78 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:49.519371 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7517371-bf02-4603-a045-20733a214f78 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:49.690112 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b2fae7ae-a8f9-4d77-bbb9-8c5fb420ca06 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:53:49.690969 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b2fae7ae-a8f9-4d77-bbb9-8c5fb420ca06 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] [instance: dff389e3-85df-444f-9afa-4e4acc296656] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:53:49.692073 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-a7517371-bf02-4603-a045-20733a214f78 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:53:49.698377 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2fae7ae-a8f9-4d77-bbb9-8c5fb420ca06 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:49.700714 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2fae7ae-a8f9-4d77-bbb9-8c5fb420ca06 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:49.701737 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2fae7ae-a8f9-4d77-bbb9-8c5fb420ca06 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:49.702338 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2fae7ae-a8f9-4d77-bbb9-8c5fb420ca06 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:49.706318 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a7517371-bf02-4603-a045-20733a214f78 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1760 microversion: 2.1 time: 0.211586 Oct 28 08:53:49.707348 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 728/1476] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:49 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1760 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:53:49.720741 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-b2fae7ae-a8f9-4d77-bbb9-8c5fb420ca06 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] HTTP exception thrown: Instance dff389e3-85df-444f-9afa-4e4acc296656 could not be found. Oct 28 08:53:49.721611 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b2fae7ae-a8f9-4d77-bbb9-8c5fb420ca06 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] Returning 404 to user: Instance dff389e3-85df-444f-9afa-4e4acc296656 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:53:49.722686 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b2fae7ae-a8f9-4d77-bbb9-8c5fb420ca06 tempest-VolumesSnapshotTestJSON-77159574 tempest-VolumesSnapshotTestJSON-77159574-project] 10.222.0.76 "GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656" status: 404 len: 111 microversion: 2.1 time: 0.040753 Oct 28 08:53:49.726655 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 749/1477] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:53:49 2021] GET /compute/v2.1/servers/dff389e3-85df-444f-9afa-4e4acc296656 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:53:51.134952 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-5760e5be-c298-4118-9fad-42b1e6ace526 req-ae88e059-a92e-4be8-ba4e-5f3078d2ed97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50944263-608b-4801-b378-689b85093143", "tag": "6a1f38b0-f1d6-4d99-8efa-36e104032ea5"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:53:51.137031 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:53:51.137031 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:53:51.146397 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5760e5be-c298-4118-9fad-42b1e6ace526 req-ae88e059-a92e-4be8-ba4e-5f3078d2ed97 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:53:51.146867 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5760e5be-c298-4118-9fad-42b1e6ace526 req-ae88e059-a92e-4be8-ba4e-5f3078d2ed97 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:53:51.159634 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-5760e5be-c298-4118-9fad-42b1e6ace526 req-ae88e059-a92e-4be8-ba4e-5f3078d2ed97 service nova] Creating event network-changed:6a1f38b0-f1d6-4d99-8efa-36e104032ea5 for instance 50944263-608b-4801-b378-689b85093143 on hv-cinder-81565 Oct 28 08:53:51.164824 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-5760e5be-c298-4118-9fad-42b1e6ace526 req-ae88e059-a92e-4be8-ba4e-5f3078d2ed97 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033427 Oct 28 08:53:51.165643 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 729/1478] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:53:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:54:27.276172 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-153ad635-803c-4a58-b8fd-c39213d565ac tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Action: 'create', calling method: .version_select at 0x7fed737ef9d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2085811625"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:54:27.295510 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-153ad635-803c-4a58-b8fd-c39213d565ac tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Getting quotas for project 623855e29a5d4365b1dc09eed95a5c8a. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:54:27.301363 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-153ad635-803c-4a58-b8fd-c39213d565ac tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Getting quotas for user d2ef7b4e60214c6c9b5839e9ccfaad4d and project 623855e29a5d4365b1dc09eed95a5c8a. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:54:27.587582 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-153ad635-803c-4a58-b8fd-c39213d565ac tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Getting quotas for project 623855e29a5d4365b1dc09eed95a5c8a. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:54:27.592499 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-153ad635-803c-4a58-b8fd-c39213d565ac tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Getting quotas for user d2ef7b4e60214c6c9b5839e9ccfaad4d and project 623855e29a5d4365b1dc09eed95a5c8a. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:54:27.606191 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-153ad635-803c-4a58-b8fd-c39213d565ac tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.547758 Oct 28 08:54:27.606958 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 750/1479] 10.222.0.76 () {60 vars in 1157 bytes} [Thu Oct 28 08:54:27 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:52.484378 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d52080b9-df99-4e4e-984b-730738695db7 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-244851086", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2085811625", "security_groups": [{"name": "tempest-secgroup-smoke-665603956"}], "block_device_mapping_v2": [{"uuid": "05c6379b-7ec0-49a7-a37d-2d3cbc1672b9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "446e91e7-3e48-4c38-a9f3-3e73a5ab2ab3"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:54:52.584754 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-d52080b9-df99-4e4e-984b-730738695db7 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] validate_networks() for [('446e91e7-3e48-4c38-a9f3-3e73a5ab2ab3', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:54:52.971690 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-d52080b9-df99-4e4e-984b-730738695db7 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:54:52.972112 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-d52080b9-df99-4e4e-984b-730738695db7 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:54:52.972604 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-d52080b9-df99-4e4e-984b-730738695db7 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:54:52.973014 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-d52080b9-df99-4e4e-984b-730738695db7 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:54:52.973426 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-d52080b9-df99-4e4e-984b-730738695db7 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:54:52.983238 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d52080b9-df99-4e4e-984b-730738695db7 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:52.983682 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d52080b9-df99-4e4e-984b-730738695db7 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:52.984484 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d52080b9-df99-4e4e-984b-730738695db7 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:52.984926 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d52080b9-df99-4e4e-984b-730738695db7 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:53.002105 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-d52080b9-df99-4e4e-984b-730738695db7 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Getting quotas for project 623855e29a5d4365b1dc09eed95a5c8a. Resources: {'instances', 'cores', 'ram'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:54:53.006011 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-d52080b9-df99-4e4e-984b-730738695db7 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Getting quotas for user d2ef7b4e60214c6c9b5839e9ccfaad4d and project 623855e29a5d4365b1dc09eed95a5c8a. Resources: {'instances', 'cores', 'ram'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:54:53.073990 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d52080b9-df99-4e4e-984b-730738695db7 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:54:53.076270 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d52080b9-df99-4e4e-984b-730738695db7 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 8a35e8fe-5996-4f86-9273-435cbf4967ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='05c6379b-7ec0-49a7-a37d-2d3cbc1672b9',volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:54:53.203981 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d52080b9-df99-4e4e-984b-730738695db7 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.724667 Oct 28 08:54:53.204628 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 730/1480] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Oct 28 08:54:52 2021] POST /compute/v2.1/servers => generated 405 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:54:53.215778 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8f3f1ca8-f9ef-4f3c-a564-73780487e538 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:53.216357 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8f3f1ca8-f9ef-4f3c-a564-73780487e538 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 8a35e8fe-5996-4f86-9273-435cbf4967ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:53.269465 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-8f3f1ca8-f9ef-4f3c-a564-73780487e538 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:53.277275 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8f3f1ca8-f9ef-4f3c-a564-73780487e538 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae" status: 200 len: 1094 microversion: 2.1 time: 0.066533 Oct 28 08:54:53.277861 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 751/1481] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:53 2021] GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:54.294105 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-93ba3cf0-cd9b-4c0c-b0a2-3d8f0495472c tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:54.295480 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-93ba3cf0-cd9b-4c0c-b0a2-3d8f0495472c tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 8a35e8fe-5996-4f86-9273-435cbf4967ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:54.307324 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93ba3cf0-cd9b-4c0c-b0a2-3d8f0495472c tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:54.307889 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93ba3cf0-cd9b-4c0c-b0a2-3d8f0495472c tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:54.309177 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93ba3cf0-cd9b-4c0c-b0a2-3d8f0495472c tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:54.309715 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93ba3cf0-cd9b-4c0c-b0a2-3d8f0495472c tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:54.394954 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-93ba3cf0-cd9b-4c0c-b0a2-3d8f0495472c tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:54.403082 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-93ba3cf0-cd9b-4c0c-b0a2-3d8f0495472c tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae" status: 200 len: 1210 microversion: 2.1 time: 0.113807 Oct 28 08:54:54.403847 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 731/1482] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:54 2021] GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae => generated 1210 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:55.421851 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c28a24a9-f448-4fcc-aa8e-6f80d0c578f0 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:55.422462 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c28a24a9-f448-4fcc-aa8e-6f80d0c578f0 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 8a35e8fe-5996-4f86-9273-435cbf4967ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:55.429190 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28a24a9-f448-4fcc-aa8e-6f80d0c578f0 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:55.429632 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28a24a9-f448-4fcc-aa8e-6f80d0c578f0 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:55.430425 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28a24a9-f448-4fcc-aa8e-6f80d0c578f0 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:55.430938 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28a24a9-f448-4fcc-aa8e-6f80d0c578f0 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:55.649454 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-a2cc7e90-8ff6-4d9f-8f83-13e1a24032c0 req-69daceb0-c7d2-45bb-be1a-3a892b523beb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a35e8fe-5996-4f86-9273-435cbf4967ae", "tag": "8d9bcb02-4dd4-4d89-9b5d-0f4a5a20f769"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:54:55.653512 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:54:55.653512 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:54:55.661650 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a2cc7e90-8ff6-4d9f-8f83-13e1a24032c0 req-69daceb0-c7d2-45bb-be1a-3a892b523beb service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:55.662364 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a2cc7e90-8ff6-4d9f-8f83-13e1a24032c0 req-69daceb0-c7d2-45bb-be1a-3a892b523beb service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:55.674415 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-a2cc7e90-8ff6-4d9f-8f83-13e1a24032c0 req-69daceb0-c7d2-45bb-be1a-3a892b523beb service nova] Creating event network-changed:8d9bcb02-4dd4-4d89-9b5d-0f4a5a20f769 for instance 8a35e8fe-5996-4f86-9273-435cbf4967ae on hv-cinder-81565 Oct 28 08:54:55.689410 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-a2cc7e90-8ff6-4d9f-8f83-13e1a24032c0 req-69daceb0-c7d2-45bb-be1a-3a892b523beb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046778 Oct 28 08:54:55.690685 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 732/1483] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:54:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:54:55.813583 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-c28a24a9-f448-4fcc-aa8e-6f80d0c578f0 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:55.821051 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c28a24a9-f448-4fcc-aa8e-6f80d0c578f0 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae" status: 200 len: 1265 microversion: 2.1 time: 0.402889 Oct 28 08:54:55.821670 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 752/1484] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:55 2021] GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae => generated 1265 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:56.840133 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-abb752b4-b998-4e5e-8d40-ca539343e191 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:56.840828 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-abb752b4-b998-4e5e-8d40-ca539343e191 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 8a35e8fe-5996-4f86-9273-435cbf4967ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:56.847537 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-abb752b4-b998-4e5e-8d40-ca539343e191 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:56.847987 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-abb752b4-b998-4e5e-8d40-ca539343e191 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:56.848766 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-abb752b4-b998-4e5e-8d40-ca539343e191 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:56.849204 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-abb752b4-b998-4e5e-8d40-ca539343e191 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:56.976194 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-abb752b4-b998-4e5e-8d40-ca539343e191 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:56.983786 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-abb752b4-b998-4e5e-8d40-ca539343e191 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae" status: 200 len: 1265 microversion: 2.1 time: 0.148720 Oct 28 08:54:56.984361 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 733/1485] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:56 2021] GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:58.001176 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-22eef1a2-4308-44de-9ef5-63cfb190c49f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:58.001974 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-22eef1a2-4308-44de-9ef5-63cfb190c49f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 8a35e8fe-5996-4f86-9273-435cbf4967ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:58.009687 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22eef1a2-4308-44de-9ef5-63cfb190c49f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:58.010170 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22eef1a2-4308-44de-9ef5-63cfb190c49f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:58.011067 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22eef1a2-4308-44de-9ef5-63cfb190c49f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:58.011538 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22eef1a2-4308-44de-9ef5-63cfb190c49f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:58.136791 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-22eef1a2-4308-44de-9ef5-63cfb190c49f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:58.144822 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-22eef1a2-4308-44de-9ef5-63cfb190c49f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae" status: 200 len: 1265 microversion: 2.1 time: 0.148056 Oct 28 08:54:58.145426 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 753/1486] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:57 2021] GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:54:59.162924 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6b817515-8106-4b01-8b3d-f6779f7234e8 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:54:59.163550 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6b817515-8106-4b01-8b3d-f6779f7234e8 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 8a35e8fe-5996-4f86-9273-435cbf4967ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:54:59.170711 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b817515-8106-4b01-8b3d-f6779f7234e8 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:59.171165 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b817515-8106-4b01-8b3d-f6779f7234e8 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:59.171950 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b817515-8106-4b01-8b3d-f6779f7234e8 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:54:59.172385 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b817515-8106-4b01-8b3d-f6779f7234e8 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:54:59.332675 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-6b817515-8106-4b01-8b3d-f6779f7234e8 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:54:59.341785 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6b817515-8106-4b01-8b3d-f6779f7234e8 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae" status: 200 len: 1265 microversion: 2.1 time: 0.182500 Oct 28 08:54:59.342370 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 734/1487] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:54:59 2021] GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:55:00.361471 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8d21eee2-3b68-4cb9-9b4c-28494d079321 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:00.362033 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8d21eee2-3b68-4cb9-9b4c-28494d079321 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 8a35e8fe-5996-4f86-9273-435cbf4967ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:00.368342 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d21eee2-3b68-4cb9-9b4c-28494d079321 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:00.369473 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d21eee2-3b68-4cb9-9b4c-28494d079321 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:00.369692 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d21eee2-3b68-4cb9-9b4c-28494d079321 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:00.370037 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d21eee2-3b68-4cb9-9b4c-28494d079321 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:00.500131 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-8d21eee2-3b68-4cb9-9b4c-28494d079321 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:00.507706 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8d21eee2-3b68-4cb9-9b4c-28494d079321 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae" status: 200 len: 1265 microversion: 2.1 time: 0.151175 Oct 28 08:55:00.508277 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 754/1488] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:00 2021] GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:55:01.525267 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7ddbc7a5-b7a4-4111-ae2f-cd3c171c46e1 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:01.525910 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7ddbc7a5-b7a4-4111-ae2f-cd3c171c46e1 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 8a35e8fe-5996-4f86-9273-435cbf4967ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:01.531736 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ddbc7a5-b7a4-4111-ae2f-cd3c171c46e1 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:01.532179 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ddbc7a5-b7a4-4111-ae2f-cd3c171c46e1 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:01.532954 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ddbc7a5-b7a4-4111-ae2f-cd3c171c46e1 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:01.533373 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ddbc7a5-b7a4-4111-ae2f-cd3c171c46e1 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:01.657377 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-7ddbc7a5-b7a4-4111-ae2f-cd3c171c46e1 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:01.664806 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7ddbc7a5-b7a4-4111-ae2f-cd3c171c46e1 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae" status: 200 len: 1265 microversion: 2.1 time: 0.143480 Oct 28 08:55:01.665983 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 735/1489] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:01 2021] GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:55:01.817348 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-287d41d3-3541-420a-a1d6-97fb308de596 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:55:01.818342 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-287d41d3-3541-420a-a1d6-97fb308de596 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:01.824857 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-287d41d3-3541-420a-a1d6-97fb308de596 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:01.825293 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-287d41d3-3541-420a-a1d6-97fb308de596 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:01.826070 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-287d41d3-3541-420a-a1d6-97fb308de596 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:01.826491 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-287d41d3-3541-420a-a1d6-97fb308de596 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:01.902413 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-287d41d3-3541-420a-a1d6-97fb308de596 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "POST /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143/action" status: 202 len: 0 microversion: 2.1 time: 0.088729 Oct 28 08:55:01.903083 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 755/1490] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:55:01 2021] POST /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:55:01.912497 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e7923ddd-2feb-4d52-a8c3-12d4cb8722fd tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:01.913107 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e7923ddd-2feb-4d52-a8c3-12d4cb8722fd tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:01.920143 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7923ddd-2feb-4d52-a8c3-12d4cb8722fd tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:01.920916 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7923ddd-2feb-4d52-a8c3-12d4cb8722fd tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:01.921777 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7923ddd-2feb-4d52-a8c3-12d4cb8722fd tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:01.922361 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7923ddd-2feb-4d52-a8c3-12d4cb8722fd tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:02.135129 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-e7923ddd-2feb-4d52-a8c3-12d4cb8722fd tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:02.142906 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e7923ddd-2feb-4d52-a8c3-12d4cb8722fd tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1752 microversion: 2.1 time: 0.234213 Oct 28 08:55:02.143478 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 736/1491] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:01 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1752 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:55:02.681906 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-32b0a2b4-b7ef-4c81-9db1-a2c82a9da4a2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:02.682527 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-32b0a2b4-b7ef-4c81-9db1-a2c82a9da4a2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 8a35e8fe-5996-4f86-9273-435cbf4967ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:02.690360 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32b0a2b4-b7ef-4c81-9db1-a2c82a9da4a2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:02.691205 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32b0a2b4-b7ef-4c81-9db1-a2c82a9da4a2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:02.692634 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32b0a2b4-b7ef-4c81-9db1-a2c82a9da4a2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:02.693437 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32b0a2b4-b7ef-4c81-9db1-a2c82a9da4a2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:02.838229 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-32b0a2b4-b7ef-4c81-9db1-a2c82a9da4a2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:02.845774 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-32b0a2b4-b7ef-4c81-9db1-a2c82a9da4a2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae" status: 200 len: 1265 microversion: 2.1 time: 0.167981 Oct 28 08:55:02.846354 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 756/1492] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:02 2021] GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:55:03.160884 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9ce95571-78b3-403d-b979-b87b81616afb tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:03.161475 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9ce95571-78b3-403d-b979-b87b81616afb tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:03.168663 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ce95571-78b3-403d-b979-b87b81616afb tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:03.169113 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ce95571-78b3-403d-b979-b87b81616afb tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:03.169887 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ce95571-78b3-403d-b979-b87b81616afb tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:03.170321 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ce95571-78b3-403d-b979-b87b81616afb tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:03.298383 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-9ce95571-78b3-403d-b979-b87b81616afb tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:03.306601 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9ce95571-78b3-403d-b979-b87b81616afb tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1757 microversion: 2.1 time: 0.149283 Oct 28 08:55:03.307183 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 737/1493] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:03 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1757 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:55:03.862840 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-470a8e08-07cf-434b-9c1f-1126e2f6f25b tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:03.863619 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-470a8e08-07cf-434b-9c1f-1126e2f6f25b tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 8a35e8fe-5996-4f86-9273-435cbf4967ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:03.870911 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-470a8e08-07cf-434b-9c1f-1126e2f6f25b tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:03.871356 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-470a8e08-07cf-434b-9c1f-1126e2f6f25b tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:03.872129 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-470a8e08-07cf-434b-9c1f-1126e2f6f25b tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:03.872738 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-470a8e08-07cf-434b-9c1f-1126e2f6f25b tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:03.996320 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-470a8e08-07cf-434b-9c1f-1126e2f6f25b tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:04.003642 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-470a8e08-07cf-434b-9c1f-1126e2f6f25b tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae" status: 200 len: 1265 microversion: 2.1 time: 0.144420 Oct 28 08:55:04.004220 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 757/1494] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:03 2021] GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:55:04.324317 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cafa364e-aced-466e-ba7c-f0c1ebda7d71 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:04.324960 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cafa364e-aced-466e-ba7c-f0c1ebda7d71 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:04.331486 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cafa364e-aced-466e-ba7c-f0c1ebda7d71 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:04.331933 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cafa364e-aced-466e-ba7c-f0c1ebda7d71 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:04.332708 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cafa364e-aced-466e-ba7c-f0c1ebda7d71 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:04.333147 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cafa364e-aced-466e-ba7c-f0c1ebda7d71 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:04.513897 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-cafa364e-aced-466e-ba7c-f0c1ebda7d71 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:04.521877 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cafa364e-aced-466e-ba7c-f0c1ebda7d71 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1757 microversion: 2.1 time: 0.201526 Oct 28 08:55:04.522455 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 738/1495] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:04 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1757 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:55:05.021688 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a3e75397-b546-41c4-ad12-aa1b34c86bc6 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:05.022308 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a3e75397-b546-41c4-ad12-aa1b34c86bc6 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 8a35e8fe-5996-4f86-9273-435cbf4967ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:05.029438 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a3e75397-b546-41c4-ad12-aa1b34c86bc6 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:05.029888 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a3e75397-b546-41c4-ad12-aa1b34c86bc6 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:05.030693 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a3e75397-b546-41c4-ad12-aa1b34c86bc6 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:05.031126 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a3e75397-b546-41c4-ad12-aa1b34c86bc6 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:05.159866 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-a3e75397-b546-41c4-ad12-aa1b34c86bc6 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:05.167410 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a3e75397-b546-41c4-ad12-aa1b34c86bc6 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae" status: 200 len: 1265 microversion: 2.1 time: 0.150017 Oct 28 08:55:05.168014 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 758/1496] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:05 2021] GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:55:05.539672 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bf6fc93f-69fe-4ae8-b21b-99b5fa9b8a20 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:05.540512 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bf6fc93f-69fe-4ae8-b21b-99b5fa9b8a20 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:05.547482 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf6fc93f-69fe-4ae8-b21b-99b5fa9b8a20 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:05.547965 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf6fc93f-69fe-4ae8-b21b-99b5fa9b8a20 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:05.548832 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf6fc93f-69fe-4ae8-b21b-99b5fa9b8a20 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:05.549268 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf6fc93f-69fe-4ae8-b21b-99b5fa9b8a20 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:05.676900 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-bf6fc93f-69fe-4ae8-b21b-99b5fa9b8a20 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:05.685449 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bf6fc93f-69fe-4ae8-b21b-99b5fa9b8a20 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1757 microversion: 2.1 time: 0.149911 Oct 28 08:55:05.686036 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 739/1497] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:05 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1757 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:55:06.184339 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-92858b94-c6e1-417d-8d5b-18d9fa6e7de8 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:06.184965 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-92858b94-c6e1-417d-8d5b-18d9fa6e7de8 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 8a35e8fe-5996-4f86-9273-435cbf4967ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:06.191254 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92858b94-c6e1-417d-8d5b-18d9fa6e7de8 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:06.191696 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92858b94-c6e1-417d-8d5b-18d9fa6e7de8 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:06.192461 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92858b94-c6e1-417d-8d5b-18d9fa6e7de8 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:06.192888 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92858b94-c6e1-417d-8d5b-18d9fa6e7de8 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:06.316467 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-92858b94-c6e1-417d-8d5b-18d9fa6e7de8 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:06.324265 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-92858b94-c6e1-417d-8d5b-18d9fa6e7de8 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae" status: 200 len: 1265 microversion: 2.1 time: 0.143707 Oct 28 08:55:06.324844 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 759/1498] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:06 2021] GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:55:06.703548 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2fc38960-e078-4384-885a-ada6d1fa39c5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:06.704097 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2fc38960-e078-4384-885a-ada6d1fa39c5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:06.710410 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2fc38960-e078-4384-885a-ada6d1fa39c5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:06.711133 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2fc38960-e078-4384-885a-ada6d1fa39c5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:06.711893 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2fc38960-e078-4384-885a-ada6d1fa39c5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:06.713649 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2fc38960-e078-4384-885a-ada6d1fa39c5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:06.858398 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-2fc38960-e078-4384-885a-ada6d1fa39c5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:06.866781 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2fc38960-e078-4384-885a-ada6d1fa39c5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1757 microversion: 2.1 time: 0.166628 Oct 28 08:55:06.867367 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 740/1499] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:06 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:55:07.288800 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-e2465497-416a-4fd9-bf2e-eb1f1f833db7 req-1e483bd1-929d-4452-8a58-bf4708064b0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a35e8fe-5996-4f86-9273-435cbf4967ae", "name": "network-vif-plugged", "status": "completed", "tag": "8d9bcb02-4dd4-4d89-9b5d-0f4a5a20f769"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:55:07.291342 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:55:07.291342 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:55:07.298694 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e2465497-416a-4fd9-bf2e-eb1f1f833db7 req-1e483bd1-929d-4452-8a58-bf4708064b0c service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:07.299133 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e2465497-416a-4fd9-bf2e-eb1f1f833db7 req-1e483bd1-929d-4452-8a58-bf4708064b0c service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:07.311854 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e2465497-416a-4fd9-bf2e-eb1f1f833db7 req-1e483bd1-929d-4452-8a58-bf4708064b0c service nova] Creating event network-vif-plugged:8d9bcb02-4dd4-4d89-9b5d-0f4a5a20f769 for instance 8a35e8fe-5996-4f86-9273-435cbf4967ae on hv-cinder-81565 Oct 28 08:55:07.317031 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-e2465497-416a-4fd9-bf2e-eb1f1f833db7 req-1e483bd1-929d-4452-8a58-bf4708064b0c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031796 Oct 28 08:55:07.317702 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 760/1500] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:55:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:55:07.341553 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7cfb37a6-1410-463d-ae32-752886681791 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:07.342172 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7cfb37a6-1410-463d-ae32-752886681791 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 8a35e8fe-5996-4f86-9273-435cbf4967ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:07.348436 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7cfb37a6-1410-463d-ae32-752886681791 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:07.349145 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7cfb37a6-1410-463d-ae32-752886681791 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:07.349929 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7cfb37a6-1410-463d-ae32-752886681791 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:07.350378 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7cfb37a6-1410-463d-ae32-752886681791 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:07.499596 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-7cfb37a6-1410-463d-ae32-752886681791 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:07.508731 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7cfb37a6-1410-463d-ae32-752886681791 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae" status: 200 len: 1265 microversion: 2.1 time: 0.170942 Oct 28 08:55:07.509420 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 741/1501] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:07 2021] GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:55:07.885787 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-03f693e2-99f6-4243-83cf-ca3710a78be4 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:07.886391 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-03f693e2-99f6-4243-83cf-ca3710a78be4 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:07.892622 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03f693e2-99f6-4243-83cf-ca3710a78be4 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:07.893064 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03f693e2-99f6-4243-83cf-ca3710a78be4 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:07.893865 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03f693e2-99f6-4243-83cf-ca3710a78be4 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:07.894295 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03f693e2-99f6-4243-83cf-ca3710a78be4 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:08.113791 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-03f693e2-99f6-4243-83cf-ca3710a78be4 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:08.123322 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-03f693e2-99f6-4243-83cf-ca3710a78be4 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1757 microversion: 2.1 time: 0.241889 Oct 28 08:55:08.123906 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 761/1502] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:07 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1757 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:55:08.526141 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-39c11d4e-3979-4381-9259-3195b32c27ac tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:08.526798 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-39c11d4e-3979-4381-9259-3195b32c27ac tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 8a35e8fe-5996-4f86-9273-435cbf4967ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:08.533405 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39c11d4e-3979-4381-9259-3195b32c27ac tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:08.533854 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39c11d4e-3979-4381-9259-3195b32c27ac tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:08.534733 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39c11d4e-3979-4381-9259-3195b32c27ac tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:08.535239 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39c11d4e-3979-4381-9259-3195b32c27ac tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:08.722118 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-39c11d4e-3979-4381-9259-3195b32c27ac tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:08.730708 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-39c11d4e-3979-4381-9259-3195b32c27ac tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae" status: 200 len: 1265 microversion: 2.1 time: 0.209141 Oct 28 08:55:08.731277 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 742/1503] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:08 2021] GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:55:09.141858 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7b1a61e2-cbb7-4841-a929-09894cb247f4 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:09.142468 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7b1a61e2-cbb7-4841-a929-09894cb247f4 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:09.149128 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b1a61e2-cbb7-4841-a929-09894cb247f4 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:09.150233 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b1a61e2-cbb7-4841-a929-09894cb247f4 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:09.151266 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b1a61e2-cbb7-4841-a929-09894cb247f4 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:09.151690 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b1a61e2-cbb7-4841-a929-09894cb247f4 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:09.280761 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-7b1a61e2-cbb7-4841-a929-09894cb247f4 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:09.290967 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7b1a61e2-cbb7-4841-a929-09894cb247f4 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1757 microversion: 2.1 time: 0.152578 Oct 28 08:55:09.291544 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 762/1504] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:09 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1757 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:55:09.747202 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-560d98fc-2c6e-4292-a75d-6d427eedfc78 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:09.748030 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-560d98fc-2c6e-4292-a75d-6d427eedfc78 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 8a35e8fe-5996-4f86-9273-435cbf4967ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:09.754181 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-560d98fc-2c6e-4292-a75d-6d427eedfc78 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:09.754682 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-560d98fc-2c6e-4292-a75d-6d427eedfc78 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:09.755461 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-560d98fc-2c6e-4292-a75d-6d427eedfc78 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:09.755898 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-560d98fc-2c6e-4292-a75d-6d427eedfc78 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:09.884818 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-560d98fc-2c6e-4292-a75d-6d427eedfc78 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:09.892534 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-560d98fc-2c6e-4292-a75d-6d427eedfc78 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae" status: 200 len: 1452 microversion: 2.1 time: 0.149224 Oct 28 08:55:09.893102 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 743/1505] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:09 2021] GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:55:09.908529 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-069a690c-a6e9-422f-942e-b149227e5bcf tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:09.909127 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-069a690c-a6e9-422f-942e-b149227e5bcf tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 8a35e8fe-5996-4f86-9273-435cbf4967ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:09.915057 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-069a690c-a6e9-422f-942e-b149227e5bcf tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:09.915510 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-069a690c-a6e9-422f-942e-b149227e5bcf tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:09.916272 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-069a690c-a6e9-422f-942e-b149227e5bcf tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:09.916691 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-069a690c-a6e9-422f-942e-b149227e5bcf tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:10.041770 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-069a690c-a6e9-422f-942e-b149227e5bcf tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:10.049252 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-069a690c-a6e9-422f-942e-b149227e5bcf tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae" status: 200 len: 1452 microversion: 2.1 time: 0.144369 Oct 28 08:55:10.049824 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 763/1506] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:09 2021] GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae => generated 1452 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:55:10.308594 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e4b9b3b9-3157-4c7c-8dea-546a3d9429d5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:10.309208 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e4b9b3b9-3157-4c7c-8dea-546a3d9429d5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:10.315259 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4b9b3b9-3157-4c7c-8dea-546a3d9429d5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:10.315719 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4b9b3b9-3157-4c7c-8dea-546a3d9429d5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:10.316618 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4b9b3b9-3157-4c7c-8dea-546a3d9429d5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:10.317027 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4b9b3b9-3157-4c7c-8dea-546a3d9429d5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:10.453811 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-e4b9b3b9-3157-4c7c-8dea-546a3d9429d5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:10.462173 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e4b9b3b9-3157-4c7c-8dea-546a3d9429d5 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1757 microversion: 2.1 time: 0.157988 Oct 28 08:55:10.463128 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 744/1507] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:10 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:55:11.479405 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-01cdc64b-37eb-495c-a0d6-4ac5e91866d2 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:11.480012 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-01cdc64b-37eb-495c-a0d6-4ac5e91866d2 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:11.486112 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01cdc64b-37eb-495c-a0d6-4ac5e91866d2 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:11.486586 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01cdc64b-37eb-495c-a0d6-4ac5e91866d2 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:11.487360 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01cdc64b-37eb-495c-a0d6-4ac5e91866d2 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:11.487788 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01cdc64b-37eb-495c-a0d6-4ac5e91866d2 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:11.618295 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-01cdc64b-37eb-495c-a0d6-4ac5e91866d2 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:11.626771 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-01cdc64b-37eb-495c-a0d6-4ac5e91866d2 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1757 microversion: 2.1 time: 0.150985 Oct 28 08:55:11.627345 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 764/1508] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:11 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1757 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:55:11.864303 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-7400d9b4-e5e1-42a4-af77-0baf8f2123ce req-a926287e-38e0-4546-8b68-efaff4240124 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a35e8fe-5996-4f86-9273-435cbf4967ae", "tag": "8d9bcb02-4dd4-4d89-9b5d-0f4a5a20f769"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:55:11.865843 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:55:11.865843 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:55:11.873173 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-7400d9b4-e5e1-42a4-af77-0baf8f2123ce req-a926287e-38e0-4546-8b68-efaff4240124 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:11.873623 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-7400d9b4-e5e1-42a4-af77-0baf8f2123ce req-a926287e-38e0-4546-8b68-efaff4240124 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:11.885548 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-7400d9b4-e5e1-42a4-af77-0baf8f2123ce req-a926287e-38e0-4546-8b68-efaff4240124 service nova] Creating event network-changed:8d9bcb02-4dd4-4d89-9b5d-0f4a5a20f769 for instance 8a35e8fe-5996-4f86-9273-435cbf4967ae on hv-cinder-81565 Oct 28 08:55:11.890705 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-7400d9b4-e5e1-42a4-af77-0baf8f2123ce req-a926287e-38e0-4546-8b68-efaff4240124 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108682 Oct 28 08:55:11.891414 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 745/1509] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:55:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:55:12.643793 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8ebd7615-10a2-4c21-a451-bde1fbb5bfec tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:12.644402 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8ebd7615-10a2-4c21-a451-bde1fbb5bfec tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:12.651067 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ebd7615-10a2-4c21-a451-bde1fbb5bfec tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:12.651509 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ebd7615-10a2-4c21-a451-bde1fbb5bfec tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:12.652286 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ebd7615-10a2-4c21-a451-bde1fbb5bfec tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:12.652710 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ebd7615-10a2-4c21-a451-bde1fbb5bfec tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:12.821327 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-8ebd7615-10a2-4c21-a451-bde1fbb5bfec tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:12.831936 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8ebd7615-10a2-4c21-a451-bde1fbb5bfec tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1757 microversion: 2.1 time: 0.191369 Oct 28 08:55:12.832605 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 765/1510] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:12 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:55:13.852723 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fd258191-6018-4351-b2f0-19cb367e0479 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:55:13.853420 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fd258191-6018-4351-b2f0-19cb367e0479 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:55:13.860043 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd258191-6018-4351-b2f0-19cb367e0479 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:13.860486 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd258191-6018-4351-b2f0-19cb367e0479 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:13.861258 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd258191-6018-4351-b2f0-19cb367e0479 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:55:13.861694 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd258191-6018-4351-b2f0-19cb367e0479 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:55:13.989278 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-fd258191-6018-4351-b2f0-19cb367e0479 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:55:13.998182 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fd258191-6018-4351-b2f0-19cb367e0479 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1760 microversion: 2.1 time: 0.150250 Oct 28 08:55:13.998804 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 746/1511] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:55:13 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1760 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:56:17.774759 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c1de7b97-1c69-4e73-aefe-641238729fa8 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1822537556"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:56:17.775385 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c1de7b97-1c69-4e73-aefe-641238729fa8 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:56:17.780882 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c1de7b97-1c69-4e73-aefe-641238729fa8 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:56:17.781324 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c1de7b97-1c69-4e73-aefe-641238729fa8 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:56:17.782082 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c1de7b97-1c69-4e73-aefe-641238729fa8 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:56:17.782534 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c1de7b97-1c69-4e73-aefe-641238729fa8 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:56:17.909300 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.network.security_group_api [None req-c1de7b97-1c69-4e73-aefe-641238729fa8 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Removing security group d957e04d-9d81-48e7-ae44-16c6740f0129 from port 6a1f38b0-f1d6-4d99-8efa-36e104032ea5 Oct 28 08:56:18.257083 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c1de7b97-1c69-4e73-aefe-641238729fa8 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "POST /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143/action" status: 202 len: 0 microversion: 2.1 time: 0.487820 Oct 28 08:56:18.261377 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 766/1512] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Oct 28 08:56:17 2021] POST /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:56:18.364310 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-2265826a-dda5-4fb5-a436-16dcae863e94 req-7cdbefbb-90c2-4d11-b98f-a2c0d384f9eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50944263-608b-4801-b378-689b85093143", "tag": "6a1f38b0-f1d6-4d99-8efa-36e104032ea5"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:56:18.366597 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:56:18.366597 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:56:18.376148 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2265826a-dda5-4fb5-a436-16dcae863e94 req-7cdbefbb-90c2-4d11-b98f-a2c0d384f9eb service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:56:18.376987 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2265826a-dda5-4fb5-a436-16dcae863e94 req-7cdbefbb-90c2-4d11-b98f-a2c0d384f9eb service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:56:18.390675 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-2265826a-dda5-4fb5-a436-16dcae863e94 req-7cdbefbb-90c2-4d11-b98f-a2c0d384f9eb service nova] Creating event network-changed:6a1f38b0-f1d6-4d99-8efa-36e104032ea5 for instance 50944263-608b-4801-b378-689b85093143 on hv-cinder-81565 Oct 28 08:56:18.397510 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-2265826a-dda5-4fb5-a436-16dcae863e94 req-7cdbefbb-90c2-4d11-b98f-a2c0d384f9eb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124754 Oct 28 08:56:18.399678 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 747/1513] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:56:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:56:19.629228 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4e032cc1-7140-42eb-89f8-a84238a37be2 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:56:19.629769 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4e032cc1-7140-42eb-89f8-a84238a37be2 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:56:19.634143 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-536d5274-ddc2-46ed-b516-7b073e66777c req-6b997355-6e72-4501-9d7a-dcff64c863fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50944263-608b-4801-b378-689b85093143", "tag": "6a1f38b0-f1d6-4d99-8efa-36e104032ea5"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:56:19.636008 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e032cc1-7140-42eb-89f8-a84238a37be2 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:56:19.636321 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:56:19.636321 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:56:19.636520 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e032cc1-7140-42eb-89f8-a84238a37be2 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:56:19.637221 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e032cc1-7140-42eb-89f8-a84238a37be2 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:56:19.637653 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e032cc1-7140-42eb-89f8-a84238a37be2 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:56:19.645090 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-536d5274-ddc2-46ed-b516-7b073e66777c req-6b997355-6e72-4501-9d7a-dcff64c863fc service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:56:19.645090 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-536d5274-ddc2-46ed-b516-7b073e66777c req-6b997355-6e72-4501-9d7a-dcff64c863fc service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:56:19.658192 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-536d5274-ddc2-46ed-b516-7b073e66777c req-6b997355-6e72-4501-9d7a-dcff64c863fc service nova] Creating event network-changed:6a1f38b0-f1d6-4d99-8efa-36e104032ea5 for instance 50944263-608b-4801-b378-689b85093143 on hv-cinder-81565 Oct 28 08:56:19.664746 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-536d5274-ddc2-46ed-b516-7b073e66777c req-6b997355-6e72-4501-9d7a-dcff64c863fc service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035745 Oct 28 08:56:19.665523 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 748/1514] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:56:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:56:19.732631 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-4e032cc1-7140-42eb-89f8-a84238a37be2 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lazy-loading 'services' on Instance uuid 50944263-608b-4801-b378-689b85093143 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 08:56:19.809279 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4e032cc1-7140-42eb-89f8-a84238a37be2 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "DELETE /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143/os-volume_attachments/22957ac0-04ed-4101-b5ef-240898f4130a" status: 202 len: 0 microversion: 2.1 time: 0.184480 Oct 28 08:56:19.810011 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 767/1515] 10.222.0.76 () {58 vars in 1415 bytes} [Thu Oct 28 08:56:19 2021] DELETE /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143/os-volume_attachments/22957ac0-04ed-4101-b5ef-240898f4130a => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 08:56:19.820749 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-38550958-ae1e-43b2-92d8-57f8cf22594c tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:56:19.821917 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-38550958-ae1e-43b2-92d8-57f8cf22594c tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:56:19.830082 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38550958-ae1e-43b2-92d8-57f8cf22594c tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:56:19.830792 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38550958-ae1e-43b2-92d8-57f8cf22594c tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:56:19.831653 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38550958-ae1e-43b2-92d8-57f8cf22594c tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:56:19.832172 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38550958-ae1e-43b2-92d8-57f8cf22594c tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:56:19.876488 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-38550958-ae1e-43b2-92d8-57f8cf22594c tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061247 Oct 28 08:56:19.877204 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 749/1516] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Oct 28 08:56:19 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:56:20.889000 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8c887e91-0767-41ee-b202-ed8bc9ab77dd tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:56:20.890056 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8c887e91-0767-41ee-b202-ed8bc9ab77dd tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:56:20.896593 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c887e91-0767-41ee-b202-ed8bc9ab77dd tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:56:20.897040 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c887e91-0767-41ee-b202-ed8bc9ab77dd tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:56:20.897805 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c887e91-0767-41ee-b202-ed8bc9ab77dd tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:56:20.898909 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c887e91-0767-41ee-b202-ed8bc9ab77dd tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:56:20.927514 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8c887e91-0767-41ee-b202-ed8bc9ab77dd tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042604 Oct 28 08:56:20.928088 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 768/1517] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Oct 28 08:56:20 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 08:56:20.937855 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-37f2373d-64eb-4bbc-ac16-7df4c8fa9e6a tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:56:20.938394 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-37f2373d-64eb-4bbc-ac16-7df4c8fa9e6a tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:56:20.944700 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37f2373d-64eb-4bbc-ac16-7df4c8fa9e6a tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:56:20.946237 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37f2373d-64eb-4bbc-ac16-7df4c8fa9e6a tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:56:20.946960 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37f2373d-64eb-4bbc-ac16-7df4c8fa9e6a tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:56:20.947406 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37f2373d-64eb-4bbc-ac16-7df4c8fa9e6a tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:56:21.021536 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-37f2373d-64eb-4bbc-ac16-7df4c8fa9e6a tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] HTTP exception thrown: Instance 50944263-608b-4801-b378-689b85093143 is not attached to volume 22957ac0-04ed-4101-b5ef-240898f4130a Oct 28 08:56:21.022160 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-37f2373d-64eb-4bbc-ac16-7df4c8fa9e6a tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Returning 404 to user: Instance 50944263-608b-4801-b378-689b85093143 is not attached to volume 22957ac0-04ed-4101-b5ef-240898f4130a {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:56:21.024447 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-37f2373d-64eb-4bbc-ac16-7df4c8fa9e6a tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "DELETE /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143/os-volume_attachments/22957ac0-04ed-4101-b5ef-240898f4130a" status: 404 len: 154 microversion: 2.1 time: 0.089080 Oct 28 08:56:21.025009 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 750/1518] 10.222.0.76 () {58 vars in 1415 bytes} [Thu Oct 28 08:56:20 2021] DELETE /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143/os-volume_attachments/22957ac0-04ed-4101-b5ef-240898f4130a => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:56:22.155709 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4b64f20b-ba85-40a5-92d0-30d1f10cd302 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:56:22.156261 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4b64f20b-ba85-40a5-92d0-30d1f10cd302 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:56:22.162340 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4b64f20b-ba85-40a5-92d0-30d1f10cd302 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:56:22.162879 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4b64f20b-ba85-40a5-92d0-30d1f10cd302 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:56:22.163645 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4b64f20b-ba85-40a5-92d0-30d1f10cd302 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:56:22.164134 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4b64f20b-ba85-40a5-92d0-30d1f10cd302 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:56:22.191154 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4b64f20b-ba85-40a5-92d0-30d1f10cd302 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:56:22.271275 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4b64f20b-ba85-40a5-92d0-30d1f10cd302 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "DELETE /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 204 len: 0 microversion: 2.1 time: 0.118764 Oct 28 08:56:22.272031 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 769/1519] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Oct 28 08:56:22 2021] DELETE /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:56:22.280976 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c1613cb9-4c32-46f0-bb78-7a94ed92078e tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:56:22.281578 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c1613cb9-4c32-46f0-bb78-7a94ed92078e tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:56:22.288002 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1613cb9-4c32-46f0-bb78-7a94ed92078e tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:56:22.288985 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1613cb9-4c32-46f0-bb78-7a94ed92078e tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:56:22.289827 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1613cb9-4c32-46f0-bb78-7a94ed92078e tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:56:22.290298 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1613cb9-4c32-46f0-bb78-7a94ed92078e tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:56:22.419407 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c1613cb9-4c32-46f0-bb78-7a94ed92078e tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:56:22.426806 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c1613cb9-4c32-46f0-bb78-7a94ed92078e tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1554 microversion: 2.1 time: 0.149914 Oct 28 08:56:22.427364 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 751/1520] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:56:22 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:56:23.446266 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1c684829-78fd-422b-a3ca-fc41de6a7e15 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:56:23.446867 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1c684829-78fd-422b-a3ca-fc41de6a7e15 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:56:23.453089 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c684829-78fd-422b-a3ca-fc41de6a7e15 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:56:23.453523 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c684829-78fd-422b-a3ca-fc41de6a7e15 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:56:23.454278 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c684829-78fd-422b-a3ca-fc41de6a7e15 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:56:23.454738 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c684829-78fd-422b-a3ca-fc41de6a7e15 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:56:23.582629 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1c684829-78fd-422b-a3ca-fc41de6a7e15 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:56:23.591220 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1c684829-78fd-422b-a3ca-fc41de6a7e15 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1554 microversion: 2.1 time: 0.149671 Oct 28 08:56:23.591901 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 770/1521] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:56:23 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:56:24.608515 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-43c126ad-7be3-47e7-8bec-5cb4b1ff3a30 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:56:24.609162 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-43c126ad-7be3-47e7-8bec-5cb4b1ff3a30 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:56:24.617968 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43c126ad-7be3-47e7-8bec-5cb4b1ff3a30 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:56:24.618413 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43c126ad-7be3-47e7-8bec-5cb4b1ff3a30 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:56:24.619589 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43c126ad-7be3-47e7-8bec-5cb4b1ff3a30 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:56:24.620197 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43c126ad-7be3-47e7-8bec-5cb4b1ff3a30 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:56:24.820235 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-43c126ad-7be3-47e7-8bec-5cb4b1ff3a30 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d00d9bbd6f1477eb0998236b921007e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64a3a87a40249f8993dee5bc1950484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:56:24.828288 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-43c126ad-7be3-47e7-8bec-5cb4b1ff3a30 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 200 len: 1554 microversion: 2.1 time: 0.223448 Oct 28 08:56:24.828866 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 752/1522] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:56:24 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 1554 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:56:24.917264 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-518f220a-8c1b-4d5e-8e82-09bcae096646 req-54242f77-7fde-4a11-9cbb-30c5cb4566ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50944263-608b-4801-b378-689b85093143", "name": "network-vif-deleted", "tag": "6a1f38b0-f1d6-4d99-8efa-36e104032ea5"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:56:24.919647 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:56:24.919647 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 08:56:24.927306 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-518f220a-8c1b-4d5e-8e82-09bcae096646 req-54242f77-7fde-4a11-9cbb-30c5cb4566ea service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:56:24.928004 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-518f220a-8c1b-4d5e-8e82-09bcae096646 req-54242f77-7fde-4a11-9cbb-30c5cb4566ea service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:56:24.940168 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-518f220a-8c1b-4d5e-8e82-09bcae096646 req-54242f77-7fde-4a11-9cbb-30c5cb4566ea service nova] Creating event network-vif-deleted:6a1f38b0-f1d6-4d99-8efa-36e104032ea5 for instance 50944263-608b-4801-b378-689b85093143 on hv-cinder-81565 Oct 28 08:56:24.945365 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-518f220a-8c1b-4d5e-8e82-09bcae096646 req-54242f77-7fde-4a11-9cbb-30c5cb4566ea service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032256 Oct 28 08:56:24.946184 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 771/1523] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:56:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:56:25.846535 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ead552ab-3ef2-47b8-8cb3-0d214c193fc1 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:56:25.847137 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ead552ab-3ef2-47b8-8cb3-0d214c193fc1 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] [instance: 50944263-608b-4801-b378-689b85093143] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:56:25.854120 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ead552ab-3ef2-47b8-8cb3-0d214c193fc1 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:56:25.854583 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ead552ab-3ef2-47b8-8cb3-0d214c193fc1 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:56:25.855351 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ead552ab-3ef2-47b8-8cb3-0d214c193fc1 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:56:25.855771 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ead552ab-3ef2-47b8-8cb3-0d214c193fc1 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:56:25.871497 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-ead552ab-3ef2-47b8-8cb3-0d214c193fc1 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] HTTP exception thrown: Instance 50944263-608b-4801-b378-689b85093143 could not be found. Oct 28 08:56:25.872076 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ead552ab-3ef2-47b8-8cb3-0d214c193fc1 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Returning 404 to user: Instance 50944263-608b-4801-b378-689b85093143 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:56:25.872902 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ead552ab-3ef2-47b8-8cb3-0d214c193fc1 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143" status: 404 len: 111 microversion: 2.1 time: 0.030116 Oct 28 08:56:25.873447 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 753/1524] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:56:25 2021] GET /compute/v2.1/servers/50944263-608b-4801-b378-689b85093143 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 08:56:25.882008 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3c1d8c5d-1112-45af-9e88-98f3aab31c89 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] Calling method '.version_select at 0x7fed6f3b70d0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:56:25.900736 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3c1d8c5d-1112-45af-9e88-98f3aab31c89 tempest-TestMinimumBasicScenario-3178612 tempest-TestMinimumBasicScenario-3178612-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-361138060" status: 202 len: 0 microversion: 2.1 time: 0.022630 Oct 28 08:56:25.901357 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 772/1525] 10.222.0.76 () {58 vars in 1268 bytes} [Thu Oct 28 08:56:25 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-361138060 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 08:57:38.455114 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-acb8b28e-05a6-473c-94e4-1d546ce4f0bb tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:57:38.455740 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-acb8b28e-05a6-473c-94e4-1d546ce4f0bb tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 8a35e8fe-5996-4f86-9273-435cbf4967ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:57:38.462229 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-acb8b28e-05a6-473c-94e4-1d546ce4f0bb tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:38.462701 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-acb8b28e-05a6-473c-94e4-1d546ce4f0bb tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:38.463457 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-acb8b28e-05a6-473c-94e4-1d546ce4f0bb tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:38.463879 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-acb8b28e-05a6-473c-94e4-1d546ce4f0bb tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:38.488600 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-acb8b28e-05a6-473c-94e4-1d546ce4f0bb tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 8a35e8fe-5996-4f86-9273-435cbf4967ae] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 08:57:38.576272 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-acb8b28e-05a6-473c-94e4-1d546ce4f0bb tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "DELETE /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae" status: 204 len: 0 microversion: 2.1 time: 0.125551 Oct 28 08:57:38.576861 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 754/1526] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Oct 28 08:57:38 2021] DELETE /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 08:57:38.587517 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7513764b-0932-4ca7-ab99-f4a5e402abff tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:57:38.588234 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7513764b-0932-4ca7-ab99-f4a5e402abff tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 8a35e8fe-5996-4f86-9273-435cbf4967ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:57:38.594362 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7513764b-0932-4ca7-ab99-f4a5e402abff tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:38.594833 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7513764b-0932-4ca7-ab99-f4a5e402abff tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:38.595588 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7513764b-0932-4ca7-ab99-f4a5e402abff tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:38.596015 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7513764b-0932-4ca7-ab99-f4a5e402abff tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:38.718720 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-7513764b-0932-4ca7-ab99-f4a5e402abff tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:57:38.726994 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7513764b-0932-4ca7-ab99-f4a5e402abff tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae" status: 200 len: 1577 microversion: 2.1 time: 0.145610 Oct 28 08:57:38.727570 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 773/1527] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:57:38 2021] GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae => generated 1577 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:57:39.745318 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e7b64ae3-32b3-4e27-987f-74a109471e90 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:57:39.746016 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e7b64ae3-32b3-4e27-987f-74a109471e90 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 8a35e8fe-5996-4f86-9273-435cbf4967ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:57:39.752794 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7b64ae3-32b3-4e27-987f-74a109471e90 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:39.753242 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7b64ae3-32b3-4e27-987f-74a109471e90 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:39.754017 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7b64ae3-32b3-4e27-987f-74a109471e90 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:39.754792 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7b64ae3-32b3-4e27-987f-74a109471e90 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:39.886193 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-e7b64ae3-32b3-4e27-987f-74a109471e90 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:57:39.893842 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e7b64ae3-32b3-4e27-987f-74a109471e90 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae" status: 200 len: 1577 microversion: 2.1 time: 0.152560 Oct 28 08:57:39.894406 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 755/1528] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:57:39 2021] GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:57:40.911407 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-95a7bf1c-3ce2-4a60-b880-cbcf737f83e9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:57:40.913312 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-95a7bf1c-3ce2-4a60-b880-cbcf737f83e9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 8a35e8fe-5996-4f86-9273-435cbf4967ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:57:40.919744 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95a7bf1c-3ce2-4a60-b880-cbcf737f83e9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:40.920175 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95a7bf1c-3ce2-4a60-b880-cbcf737f83e9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:40.920999 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95a7bf1c-3ce2-4a60-b880-cbcf737f83e9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:40.921425 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95a7bf1c-3ce2-4a60-b880-cbcf737f83e9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:40.991223 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-95a7bf1c-3ce2-4a60-b880-cbcf737f83e9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:57:40.998628 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-95a7bf1c-3ce2-4a60-b880-cbcf737f83e9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae" status: 200 len: 1510 microversion: 2.1 time: 0.090831 Oct 28 08:57:40.999210 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 774/1529] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:57:40 2021] GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae => generated 1510 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:57:41.181502 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-52f42fec-9301-4c88-9e2e-51afcf8876f1 req-d5c9adad-6ca0-404d-9ca3-1516f39d9a8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a35e8fe-5996-4f86-9273-435cbf4967ae", "name": "network-vif-deleted", "tag": "8d9bcb02-4dd4-4d89-9b5d-0f4a5a20f769"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:57:41.184357 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:57:41.184357 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:57:41.196261 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-52f42fec-9301-4c88-9e2e-51afcf8876f1 req-d5c9adad-6ca0-404d-9ca3-1516f39d9a8e service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:41.197068 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-52f42fec-9301-4c88-9e2e-51afcf8876f1 req-d5c9adad-6ca0-404d-9ca3-1516f39d9a8e service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:41.214616 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-52f42fec-9301-4c88-9e2e-51afcf8876f1 req-d5c9adad-6ca0-404d-9ca3-1516f39d9a8e service nova] Creating event network-vif-deleted:8d9bcb02-4dd4-4d89-9b5d-0f4a5a20f769 for instance 8a35e8fe-5996-4f86-9273-435cbf4967ae on hv-cinder-81565 Oct 28 08:57:41.220091 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-52f42fec-9301-4c88-9e2e-51afcf8876f1 req-d5c9adad-6ca0-404d-9ca3-1516f39d9a8e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048018 Oct 28 08:57:41.221195 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 756/1530] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:57:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:57:42.025108 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f8931a92-6dec-4ca7-b299-9c7acfc82cf2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:57:42.025765 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f8931a92-6dec-4ca7-b299-9c7acfc82cf2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 8a35e8fe-5996-4f86-9273-435cbf4967ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:57:42.032580 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8931a92-6dec-4ca7-b299-9c7acfc82cf2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:42.033036 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8931a92-6dec-4ca7-b299-9c7acfc82cf2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:42.033816 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8931a92-6dec-4ca7-b299-9c7acfc82cf2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:42.034248 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8931a92-6dec-4ca7-b299-9c7acfc82cf2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:42.053317 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-f8931a92-6dec-4ca7-b299-9c7acfc82cf2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] HTTP exception thrown: Instance 8a35e8fe-5996-4f86-9273-435cbf4967ae could not be found. Oct 28 08:57:42.054120 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f8931a92-6dec-4ca7-b299-9c7acfc82cf2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Returning 404 to user: Instance 8a35e8fe-5996-4f86-9273-435cbf4967ae could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 08:57:42.055011 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f8931a92-6dec-4ca7-b299-9c7acfc82cf2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae" status: 404 len: 111 microversion: 2.1 time: 0.036235 Oct 28 08:57:42.055583 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 775/1531] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:57:42 2021] GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 08:57:42.170032 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0f0d2b11-71cd-40a5-9613-4863c0546a2e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-464362449", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2085811625", "security_groups": [{"name": "tempest-secgroup-smoke-665603956"}], "block_device_mapping_v2": [{"uuid": "05c6379b-7ec0-49a7-a37d-2d3cbc1672b9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "446e91e7-3e48-4c38-a9f3-3e73a5ab2ab3"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:57:42.310878 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-0f0d2b11-71cd-40a5-9613-4863c0546a2e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] validate_networks() for [('446e91e7-3e48-4c38-a9f3-3e73a5ab2ab3', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 08:57:42.821772 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-0f0d2b11-71cd-40a5-9613-4863c0546a2e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 08:57:42.822572 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-0f0d2b11-71cd-40a5-9613-4863c0546a2e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 08:57:42.823486 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-0f0d2b11-71cd-40a5-9613-4863c0546a2e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 08:57:42.824194 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-0f0d2b11-71cd-40a5-9613-4863c0546a2e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 08:57:42.824742 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-0f0d2b11-71cd-40a5-9613-4863c0546a2e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 08:57:42.837646 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f0d2b11-71cd-40a5-9613-4863c0546a2e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:42.838422 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f0d2b11-71cd-40a5-9613-4863c0546a2e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:42.839717 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f0d2b11-71cd-40a5-9613-4863c0546a2e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:42.840582 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f0d2b11-71cd-40a5-9613-4863c0546a2e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:42.871026 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-0f0d2b11-71cd-40a5-9613-4863c0546a2e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Getting quotas for project 623855e29a5d4365b1dc09eed95a5c8a. Resources: {'instances', 'cores', 'ram'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 08:57:42.877756 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.quota [None req-0f0d2b11-71cd-40a5-9613-4863c0546a2e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Getting quotas for user d2ef7b4e60214c6c9b5839e9ccfaad4d and project 623855e29a5d4365b1dc09eed95a5c8a. Resources: {'instances', 'cores', 'ram'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 08:57:42.957520 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0f0d2b11-71cd-40a5-9613-4863c0546a2e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 08:57:42.961130 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0f0d2b11-71cd-40a5-9613-4863c0546a2e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: cef0d208-c139-4164-ab75-a4172916e47f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='05c6379b-7ec0-49a7-a37d-2d3cbc1672b9',volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 08:57:43.108296 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0f0d2b11-71cd-40a5-9613-4863c0546a2e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.942113 Oct 28 08:57:43.109526 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 757/1532] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Oct 28 08:57:42 2021] POST /compute/v2.1/servers => generated 405 bytes in 944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 08:57:43.120313 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0b385e52-796d-48ae-9d10-29fee988e920 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:57:43.120928 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0b385e52-796d-48ae-9d10-29fee988e920 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: cef0d208-c139-4164-ab75-a4172916e47f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:57:43.175265 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-0b385e52-796d-48ae-9d10-29fee988e920 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:57:43.182681 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0b385e52-796d-48ae-9d10-29fee988e920 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f" status: 200 len: 1094 microversion: 2.1 time: 0.065897 Oct 28 08:57:43.183343 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 776/1533] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:57:43 2021] GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:57:44.200318 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-323141af-3fc6-4ac7-a832-a5e98b120f43 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:57:44.201071 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-323141af-3fc6-4ac7-a832-a5e98b120f43 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: cef0d208-c139-4164-ab75-a4172916e47f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:57:44.254286 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-323141af-3fc6-4ac7-a832-a5e98b120f43 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:57:44.262683 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-323141af-3fc6-4ac7-a832-a5e98b120f43 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f" status: 200 len: 1094 microversion: 2.1 time: 0.066337 Oct 28 08:57:44.263243 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 758/1534] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:57:44 2021] GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:57:45.281138 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-872c6d67-3526-4b62-8669-c10ce48362e2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:57:45.281728 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-872c6d67-3526-4b62-8669-c10ce48362e2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: cef0d208-c139-4164-ab75-a4172916e47f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:57:45.335380 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-872c6d67-3526-4b62-8669-c10ce48362e2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:57:45.342166 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-872c6d67-3526-4b62-8669-c10ce48362e2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f" status: 200 len: 1094 microversion: 2.1 time: 0.064749 Oct 28 08:57:45.342782 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 777/1535] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:57:45 2021] GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:57:46.359791 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bf47d676-52ad-4c87-bc79-7f81209dd208 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:57:46.360332 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bf47d676-52ad-4c87-bc79-7f81209dd208 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: cef0d208-c139-4164-ab75-a4172916e47f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:57:46.414256 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-bf47d676-52ad-4c87-bc79-7f81209dd208 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:57:46.420873 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bf47d676-52ad-4c87-bc79-7f81209dd208 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f" status: 200 len: 1094 microversion: 2.1 time: 0.064871 Oct 28 08:57:46.421428 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 759/1536] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:57:46 2021] GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:57:47.436996 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1c08740b-659c-4821-a9cf-618a53b832b1 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:57:47.437591 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1c08740b-659c-4821-a9cf-618a53b832b1 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: cef0d208-c139-4164-ab75-a4172916e47f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:57:47.444821 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c08740b-659c-4821-a9cf-618a53b832b1 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:47.445258 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c08740b-659c-4821-a9cf-618a53b832b1 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:47.446009 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c08740b-659c-4821-a9cf-618a53b832b1 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:47.446431 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c08740b-659c-4821-a9cf-618a53b832b1 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:47.511529 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1c08740b-659c-4821-a9cf-618a53b832b1 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:57:47.518892 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1c08740b-659c-4821-a9cf-618a53b832b1 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f" status: 200 len: 1144 microversion: 2.1 time: 0.085537 Oct 28 08:57:47.519462 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 778/1537] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:57:47 2021] GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:57:48.535937 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-300b3de9-5240-47ec-b197-d67a4342af5f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:57:48.536715 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-300b3de9-5240-47ec-b197-d67a4342af5f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: cef0d208-c139-4164-ab75-a4172916e47f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:57:48.543937 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-300b3de9-5240-47ec-b197-d67a4342af5f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:48.544471 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-300b3de9-5240-47ec-b197-d67a4342af5f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:48.545255 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-300b3de9-5240-47ec-b197-d67a4342af5f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:48.545694 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-300b3de9-5240-47ec-b197-d67a4342af5f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:48.618422 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-300b3de9-5240-47ec-b197-d67a4342af5f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:57:48.626114 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-300b3de9-5240-47ec-b197-d67a4342af5f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f" status: 200 len: 1210 microversion: 2.1 time: 0.093869 Oct 28 08:57:48.626839 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 760/1538] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:57:48 2021] GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:57:49.643559 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b8e468a4-0258-431c-8515-c6467fe2455b tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:57:49.644575 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b8e468a4-0258-431c-8515-c6467fe2455b tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: cef0d208-c139-4164-ab75-a4172916e47f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:57:49.653992 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8e468a4-0258-431c-8515-c6467fe2455b tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:49.656544 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8e468a4-0258-431c-8515-c6467fe2455b tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:49.657825 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8e468a4-0258-431c-8515-c6467fe2455b tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:49.658272 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8e468a4-0258-431c-8515-c6467fe2455b tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:49.718989 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-3d9c7ecd-14ec-44ff-98b1-d4502ae0edbd req-36bcc2ee-f8ba-4d2e-9112-eebccd548b76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cef0d208-c139-4164-ab75-a4172916e47f", "tag": "3d21ebbc-3cae-4880-8a80-7a32fcbd7d15"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:57:49.720845 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:57:49.720845 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:57:49.729946 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3d9c7ecd-14ec-44ff-98b1-d4502ae0edbd req-36bcc2ee-f8ba-4d2e-9112-eebccd548b76 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:49.730553 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3d9c7ecd-14ec-44ff-98b1-d4502ae0edbd req-36bcc2ee-f8ba-4d2e-9112-eebccd548b76 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:49.743092 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-3d9c7ecd-14ec-44ff-98b1-d4502ae0edbd req-36bcc2ee-f8ba-4d2e-9112-eebccd548b76 service nova] Creating event network-changed:3d21ebbc-3cae-4880-8a80-7a32fcbd7d15 for instance cef0d208-c139-4164-ab75-a4172916e47f on hv-cinder-81565 Oct 28 08:57:49.749844 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-3d9c7ecd-14ec-44ff-98b1-d4502ae0edbd req-36bcc2ee-f8ba-4d2e-9112-eebccd548b76 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033737 Oct 28 08:57:49.752151 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 761/1539] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:57:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:57:49.937624 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-b8e468a4-0258-431c-8515-c6467fe2455b tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:57:49.946143 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b8e468a4-0258-431c-8515-c6467fe2455b tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f" status: 200 len: 1265 microversion: 2.1 time: 0.306495 Oct 28 08:57:49.946758 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 779/1540] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:57:49 2021] GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f => generated 1265 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:57:50.963956 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-81c4ca0b-a0e8-441f-b36c-232851744534 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:57:50.964646 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-81c4ca0b-a0e8-441f-b36c-232851744534 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: cef0d208-c139-4164-ab75-a4172916e47f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:57:50.970558 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81c4ca0b-a0e8-441f-b36c-232851744534 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:50.971002 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81c4ca0b-a0e8-441f-b36c-232851744534 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:50.971767 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81c4ca0b-a0e8-441f-b36c-232851744534 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:50.972189 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81c4ca0b-a0e8-441f-b36c-232851744534 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:51.145078 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-81c4ca0b-a0e8-441f-b36c-232851744534 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:57:51.153304 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-81c4ca0b-a0e8-441f-b36c-232851744534 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f" status: 200 len: 1265 microversion: 2.1 time: 0.194762 Oct 28 08:57:51.153887 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 762/1541] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:57:50 2021] GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:57:52.170748 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3524bc16-2b92-4c3b-9ea0-2ef7aa79d9da tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:57:52.171329 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3524bc16-2b92-4c3b-9ea0-2ef7aa79d9da tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: cef0d208-c139-4164-ab75-a4172916e47f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:57:52.178522 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3524bc16-2b92-4c3b-9ea0-2ef7aa79d9da tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:52.178971 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3524bc16-2b92-4c3b-9ea0-2ef7aa79d9da tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:52.179824 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3524bc16-2b92-4c3b-9ea0-2ef7aa79d9da tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:52.180279 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3524bc16-2b92-4c3b-9ea0-2ef7aa79d9da tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:52.317770 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3524bc16-2b92-4c3b-9ea0-2ef7aa79d9da tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:57:52.325116 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3524bc16-2b92-4c3b-9ea0-2ef7aa79d9da tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f" status: 200 len: 1265 microversion: 2.1 time: 0.158031 Oct 28 08:57:52.325686 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 780/1542] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:57:52 2021] GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:57:53.341205 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bfb6d4e0-70f3-46d7-bdfe-7a32b130ea31 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:57:53.341831 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bfb6d4e0-70f3-46d7-bdfe-7a32b130ea31 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: cef0d208-c139-4164-ab75-a4172916e47f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:57:53.348179 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfb6d4e0-70f3-46d7-bdfe-7a32b130ea31 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:53.348549 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfb6d4e0-70f3-46d7-bdfe-7a32b130ea31 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:53.349545 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfb6d4e0-70f3-46d7-bdfe-7a32b130ea31 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:53.349760 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfb6d4e0-70f3-46d7-bdfe-7a32b130ea31 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:53.476855 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-bfb6d4e0-70f3-46d7-bdfe-7a32b130ea31 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:57:53.484458 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bfb6d4e0-70f3-46d7-bdfe-7a32b130ea31 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f" status: 200 len: 1265 microversion: 2.1 time: 0.146972 Oct 28 08:57:53.485031 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 763/1543] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:57:53 2021] GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:57:54.502872 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4101fd54-86e0-4dea-b9c9-e1d2c6d53e7e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:57:54.503737 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4101fd54-86e0-4dea-b9c9-e1d2c6d53e7e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: cef0d208-c139-4164-ab75-a4172916e47f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:57:54.510550 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4101fd54-86e0-4dea-b9c9-e1d2c6d53e7e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:54.510993 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4101fd54-86e0-4dea-b9c9-e1d2c6d53e7e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:54.511754 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4101fd54-86e0-4dea-b9c9-e1d2c6d53e7e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:54.512181 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4101fd54-86e0-4dea-b9c9-e1d2c6d53e7e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:54.645273 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-4101fd54-86e0-4dea-b9c9-e1d2c6d53e7e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:57:54.654095 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4101fd54-86e0-4dea-b9c9-e1d2c6d53e7e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f" status: 200 len: 1265 microversion: 2.1 time: 0.155723 Oct 28 08:57:54.654705 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 781/1544] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:57:54 2021] GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:57:55.671181 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-91f169d5-d33c-4ce9-8755-ff925c2c927e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:57:55.671803 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-91f169d5-d33c-4ce9-8755-ff925c2c927e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: cef0d208-c139-4164-ab75-a4172916e47f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:57:55.678076 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91f169d5-d33c-4ce9-8755-ff925c2c927e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:55.678558 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91f169d5-d33c-4ce9-8755-ff925c2c927e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:55.679337 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91f169d5-d33c-4ce9-8755-ff925c2c927e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:55.679783 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91f169d5-d33c-4ce9-8755-ff925c2c927e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:55.815088 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-91f169d5-d33c-4ce9-8755-ff925c2c927e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:57:55.822628 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-91f169d5-d33c-4ce9-8755-ff925c2c927e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f" status: 200 len: 1265 microversion: 2.1 time: 0.155050 Oct 28 08:57:55.823200 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 764/1545] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:57:55 2021] GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:57:56.839782 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9c36e625-c1cb-439a-a75d-059b9a64692a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:57:56.840417 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9c36e625-c1cb-439a-a75d-059b9a64692a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: cef0d208-c139-4164-ab75-a4172916e47f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:57:56.847208 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c36e625-c1cb-439a-a75d-059b9a64692a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:56.847656 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c36e625-c1cb-439a-a75d-059b9a64692a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:56.848473 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c36e625-c1cb-439a-a75d-059b9a64692a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:56.849541 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c36e625-c1cb-439a-a75d-059b9a64692a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:56.978219 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-9c36e625-c1cb-439a-a75d-059b9a64692a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:57:56.989024 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9c36e625-c1cb-439a-a75d-059b9a64692a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f" status: 200 len: 1265 microversion: 2.1 time: 0.152983 Oct 28 08:57:56.990224 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 782/1546] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:57:56 2021] GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:57:58.007964 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6f48f476-af81-45ac-9c44-dc4ec53e27db tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:57:58.008589 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6f48f476-af81-45ac-9c44-dc4ec53e27db tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: cef0d208-c139-4164-ab75-a4172916e47f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:57:58.015442 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f48f476-af81-45ac-9c44-dc4ec53e27db tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:58.015920 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f48f476-af81-45ac-9c44-dc4ec53e27db tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:58.016762 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f48f476-af81-45ac-9c44-dc4ec53e27db tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:58.017232 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f48f476-af81-45ac-9c44-dc4ec53e27db tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:58.147765 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-6f48f476-af81-45ac-9c44-dc4ec53e27db tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:57:58.155513 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6f48f476-af81-45ac-9c44-dc4ec53e27db tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f" status: 200 len: 1265 microversion: 2.1 time: 0.152248 Oct 28 08:57:58.156083 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 765/1547] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:57:58 2021] GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:57:59.173735 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-947aabd1-4fc8-4d14-9e3b-9b0415c7bb15 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:57:59.174314 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-947aabd1-4fc8-4d14-9e3b-9b0415c7bb15 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: cef0d208-c139-4164-ab75-a4172916e47f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:57:59.181087 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-947aabd1-4fc8-4d14-9e3b-9b0415c7bb15 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:59.181524 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-947aabd1-4fc8-4d14-9e3b-9b0415c7bb15 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:59.182275 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-947aabd1-4fc8-4d14-9e3b-9b0415c7bb15 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:57:59.182732 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-947aabd1-4fc8-4d14-9e3b-9b0415c7bb15 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:57:59.312580 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-947aabd1-4fc8-4d14-9e3b-9b0415c7bb15 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:57:59.321189 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-947aabd1-4fc8-4d14-9e3b-9b0415c7bb15 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f" status: 200 len: 1265 microversion: 2.1 time: 0.150923 Oct 28 08:57:59.321781 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 783/1548] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:57:59 2021] GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:58:00.338680 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-896cc954-e786-4d9d-b256-2d8d6ab5aff3 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:58:00.339284 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-896cc954-e786-4d9d-b256-2d8d6ab5aff3 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: cef0d208-c139-4164-ab75-a4172916e47f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:58:00.345563 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-896cc954-e786-4d9d-b256-2d8d6ab5aff3 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:58:00.346010 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-896cc954-e786-4d9d-b256-2d8d6ab5aff3 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:58:00.346807 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-896cc954-e786-4d9d-b256-2d8d6ab5aff3 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:58:00.347238 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-896cc954-e786-4d9d-b256-2d8d6ab5aff3 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:58:00.471099 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-896cc954-e786-4d9d-b256-2d8d6ab5aff3 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:58:00.478434 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-896cc954-e786-4d9d-b256-2d8d6ab5aff3 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f" status: 200 len: 1265 microversion: 2.1 time: 0.143440 Oct 28 08:58:00.479028 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 766/1549] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:58:00 2021] GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:58:01.495765 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-62e99cc8-53c5-4234-a32d-eb3457133240 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:58:01.496433 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-62e99cc8-53c5-4234-a32d-eb3457133240 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: cef0d208-c139-4164-ab75-a4172916e47f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:58:01.502724 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62e99cc8-53c5-4234-a32d-eb3457133240 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:58:01.503173 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62e99cc8-53c5-4234-a32d-eb3457133240 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:58:01.503941 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62e99cc8-53c5-4234-a32d-eb3457133240 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:58:01.504369 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62e99cc8-53c5-4234-a32d-eb3457133240 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:58:01.667930 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-62e99cc8-53c5-4234-a32d-eb3457133240 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:58:01.675749 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-62e99cc8-53c5-4234-a32d-eb3457133240 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f" status: 200 len: 1265 microversion: 2.1 time: 0.184168 Oct 28 08:58:01.676328 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 784/1550] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:58:01 2021] GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 08:58:02.252511 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-e74850fb-e15c-4de4-9507-ec41865d07c7 req-94b27b33-dae7-4877-a6eb-9ad538c43e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cef0d208-c139-4164-ab75-a4172916e47f", "name": "network-vif-plugged", "status": "completed", "tag": "3d21ebbc-3cae-4880-8a80-7a32fcbd7d15"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:58:02.254105 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:58:02.254105 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:58:02.261824 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e74850fb-e15c-4de4-9507-ec41865d07c7 req-94b27b33-dae7-4877-a6eb-9ad538c43e78 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:58:02.262214 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e74850fb-e15c-4de4-9507-ec41865d07c7 req-94b27b33-dae7-4877-a6eb-9ad538c43e78 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:58:02.273862 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-e74850fb-e15c-4de4-9507-ec41865d07c7 req-94b27b33-dae7-4877-a6eb-9ad538c43e78 service nova] Creating event network-vif-plugged:3d21ebbc-3cae-4880-8a80-7a32fcbd7d15 for instance cef0d208-c139-4164-ab75-a4172916e47f on hv-cinder-81565 Oct 28 08:58:02.278977 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-e74850fb-e15c-4de4-9507-ec41865d07c7 req-94b27b33-dae7-4877-a6eb-9ad538c43e78 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185618 Oct 28 08:58:02.279562 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 767/1551] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:58:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 08:58:02.694046 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c2231540-f079-48bb-bac0-05a6a90608af tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:58:02.694679 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c2231540-f079-48bb-bac0-05a6a90608af tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: cef0d208-c139-4164-ab75-a4172916e47f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:58:02.700718 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2231540-f079-48bb-bac0-05a6a90608af tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:58:02.701153 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2231540-f079-48bb-bac0-05a6a90608af tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:58:02.701905 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2231540-f079-48bb-bac0-05a6a90608af tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:58:02.702330 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2231540-f079-48bb-bac0-05a6a90608af tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:58:02.827501 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-c2231540-f079-48bb-bac0-05a6a90608af tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:58:02.835460 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c2231540-f079-48bb-bac0-05a6a90608af tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f" status: 200 len: 1265 microversion: 2.1 time: 0.146299 Oct 28 08:58:02.836016 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 785/1552] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:58:02 2021] GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:58:03.853709 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-de40856b-8cd8-4760-bdad-0c379a705e46 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:58:03.855108 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-de40856b-8cd8-4760-bdad-0c379a705e46 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: cef0d208-c139-4164-ab75-a4172916e47f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:58:03.861297 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de40856b-8cd8-4760-bdad-0c379a705e46 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:58:03.861776 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de40856b-8cd8-4760-bdad-0c379a705e46 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:58:03.862570 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de40856b-8cd8-4760-bdad-0c379a705e46 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:58:03.863024 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de40856b-8cd8-4760-bdad-0c379a705e46 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:58:03.999375 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-de40856b-8cd8-4760-bdad-0c379a705e46 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:58:04.008820 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-de40856b-8cd8-4760-bdad-0c379a705e46 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f" status: 200 len: 1452 microversion: 2.1 time: 0.160630 Oct 28 08:58:04.009871 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 768/1553] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:58:03 2021] GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:58:04.026951 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bcffe1a5-8dc4-4451-9552-965b31c4dff0 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 08:58:04.027637 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bcffe1a5-8dc4-4451-9552-965b31c4dff0 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: cef0d208-c139-4164-ab75-a4172916e47f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 08:58:04.033786 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcffe1a5-8dc4-4451-9552-965b31c4dff0 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:58:04.034224 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcffe1a5-8dc4-4451-9552-965b31c4dff0 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:58:04.035139 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcffe1a5-8dc4-4451-9552-965b31c4dff0 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:58:04.035562 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcffe1a5-8dc4-4451-9552-965b31c4dff0 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:58:04.165459 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-bcffe1a5-8dc4-4451-9552-965b31c4dff0 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 08:58:04.172850 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bcffe1a5-8dc4-4451-9552-965b31c4dff0 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f" status: 200 len: 1452 microversion: 2.1 time: 0.149777 Oct 28 08:58:04.173670 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 786/1554] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 08:58:04 2021] GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 08:58:05.820881 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-8771932e-5011-4206-aaa0-ce729ab7283b req-fab2e457-0375-4606-939f-4cd3302213c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cef0d208-c139-4164-ab75-a4172916e47f", "tag": "3d21ebbc-3cae-4880-8a80-7a32fcbd7d15"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 08:58:05.823097 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:58:05.823097 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 08:58:05.830870 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8771932e-5011-4206-aaa0-ce729ab7283b req-fab2e457-0375-4606-939f-4cd3302213c5 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 08:58:05.831390 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8771932e-5011-4206-aaa0-ce729ab7283b req-fab2e457-0375-4606-939f-4cd3302213c5 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 08:58:05.844800 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-8771932e-5011-4206-aaa0-ce729ab7283b req-fab2e457-0375-4606-939f-4cd3302213c5 service nova] Creating event network-changed:3d21ebbc-3cae-4880-8a80-7a32fcbd7d15 for instance cef0d208-c139-4164-ab75-a4172916e47f on hv-cinder-81565 Oct 28 08:58:05.851508 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-8771932e-5011-4206-aaa0-ce729ab7283b req-fab2e457-0375-4606-939f-4cd3302213c5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035862 Oct 28 08:58:05.852220 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 769/1555] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 08:58:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 08:58:14.273681 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 08:58:14.274275 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: Thu Oct 28 08:58:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 08:58:23.560337 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 08:58:23.560995 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: Thu Oct 28 08:58:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 08:59:34.125460 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 08:59:34.126086 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: Thu Oct 28 08:59:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 09:00:20.353914 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: ERROR oslo.messaging._drivers.impl_rabbit [-] [14fc52f3-fbcd-41d6-92dc-f3aa5f6d0189] AMQP server on 10.222.0.76:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 09:00:20.357411 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-52b56528-5aa9-4606-924a-c822ac99393e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-460986855", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2085811625", "security_groups": [{"name": "tempest-secgroup-smoke-665603956"}], "block_device_mapping_v2": [{"uuid": "b94c7656-4253-4809-99e2-1d3b7ab65dc9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "446e91e7-3e48-4c38-a9f3-3e73a5ab2ab3"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:00:20.513855 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-52b56528-5aa9-4606-924a-c822ac99393e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] validate_networks() for [('446e91e7-3e48-4c38-a9f3-3e73a5ab2ab3', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 09:00:20.843694 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 09:00:20.844292 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: Thu Oct 28 09:00:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 09:00:21.223953 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-52b56528-5aa9-4606-924a-c822ac99393e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:00:21.224379 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-52b56528-5aa9-4606-924a-c822ac99393e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:00:21.224849 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-52b56528-5aa9-4606-924a-c822ac99393e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:00:21.225256 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-52b56528-5aa9-4606-924a-c822ac99393e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:00:21.225666 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-52b56528-5aa9-4606-924a-c822ac99393e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:00:21.235187 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-52b56528-5aa9-4606-924a-c822ac99393e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:21.236411 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-52b56528-5aa9-4606-924a-c822ac99393e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:21.237272 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-52b56528-5aa9-4606-924a-c822ac99393e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:21.237705 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-52b56528-5aa9-4606-924a-c822ac99393e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:21.254843 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-52b56528-5aa9-4606-924a-c822ac99393e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Getting quotas for project 623855e29a5d4365b1dc09eed95a5c8a. Resources: {'instances', 'cores', 'ram'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:00:21.258809 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.quota [None req-52b56528-5aa9-4606-924a-c822ac99393e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Getting quotas for user d2ef7b4e60214c6c9b5839e9ccfaad4d and project 623855e29a5d4365b1dc09eed95a5c8a. Resources: {'instances', 'cores', 'ram'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:00:21.315607 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-52b56528-5aa9-4606-924a-c822ac99393e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 09:00:21.317734 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-52b56528-5aa9-4606-924a-c822ac99393e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 604be8f6-1220-4068-aa90-4d001713b8c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b94c7656-4253-4809-99e2-1d3b7ab65dc9',volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 09:00:21.373703 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] [14fc52f3-fbcd-41d6-92dc-f3aa5f6d0189] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 41990. Oct 28 09:00:21.451112 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-52b56528-5aa9-4606-924a-c822ac99393e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.099202 Oct 28 09:00:21.451754 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 787/1556] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Oct 28 09:00:20 2021] POST /compute/v2.1/servers => generated 405 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:00:21.460869 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9ae4062d-fb55-4060-9577-1f97c1e8daac] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 09:00:21.464837 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f6e3fed7-7d1c-4b28-847f-51f30c487fe5 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:00:21.465528 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f6e3fed7-7d1c-4b28-847f-51f30c487fe5 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 604be8f6-1220-4068-aa90-4d001713b8c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:00:21.576085 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-f6e3fed7-7d1c-4b28-847f-51f30c487fe5 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:00:21.583860 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f6e3fed7-7d1c-4b28-847f-51f30c487fe5 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1" status: 200 len: 1094 microversion: 2.1 time: 0.124625 Oct 28 09:00:21.586722 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 770/1557] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 09:00:21 2021] GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1 => generated 1094 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:00:22.601098 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6480fcdd-12a6-4df3-b927-9310bb5a72a4 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:00:22.601774 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6480fcdd-12a6-4df3-b927-9310bb5a72a4 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 604be8f6-1220-4068-aa90-4d001713b8c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:00:22.608637 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6480fcdd-12a6-4df3-b927-9310bb5a72a4 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:22.609086 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6480fcdd-12a6-4df3-b927-9310bb5a72a4 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:22.609876 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6480fcdd-12a6-4df3-b927-9310bb5a72a4 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:22.610347 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6480fcdd-12a6-4df3-b927-9310bb5a72a4 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:22.682809 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-6480fcdd-12a6-4df3-b927-9310bb5a72a4 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:00:22.691722 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6480fcdd-12a6-4df3-b927-9310bb5a72a4 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1" status: 200 len: 1210 microversion: 2.1 time: 0.094695 Oct 28 09:00:22.692772 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 788/1558] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 09:00:22 2021] GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1 => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:00:23.713511 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-15fb2151-7be0-4dbc-8f08-1d090b133fe9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:00:23.714279 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-15fb2151-7be0-4dbc-8f08-1d090b133fe9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 604be8f6-1220-4068-aa90-4d001713b8c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:00:23.735992 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15fb2151-7be0-4dbc-8f08-1d090b133fe9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:23.736722 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15fb2151-7be0-4dbc-8f08-1d090b133fe9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:23.737752 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15fb2151-7be0-4dbc-8f08-1d090b133fe9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:23.738360 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15fb2151-7be0-4dbc-8f08-1d090b133fe9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:23.746760 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] [9ae4062d-fb55-4060-9577-1f97c1e8daac] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 42012. Oct 28 09:00:23.931975 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-cdf12a00-a0be-4544-a01f-00d24fc56370 req-e162ca53-ba0a-42dc-9dba-456c3508b888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "604be8f6-1220-4068-aa90-4d001713b8c1", "tag": "2567d8cf-e597-49a2-ae06-eb28e53b53f1"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:00:23.943035 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:00:23.943035 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: warnings.warn(msg) Oct 28 09:00:23.950279 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-cdf12a00-a0be-4544-a01f-00d24fc56370 req-e162ca53-ba0a-42dc-9dba-456c3508b888 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:23.950740 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-cdf12a00-a0be-4544-a01f-00d24fc56370 req-e162ca53-ba0a-42dc-9dba-456c3508b888 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:23.967248 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-cdf12a00-a0be-4544-a01f-00d24fc56370 req-e162ca53-ba0a-42dc-9dba-456c3508b888 service nova] Creating event network-changed:2567d8cf-e597-49a2-ae06-eb28e53b53f1 for instance 604be8f6-1220-4068-aa90-4d001713b8c1 on hv-cinder-81565 Oct 28 09:00:23.973170 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-cdf12a00-a0be-4544-a01f-00d24fc56370 req-e162ca53-ba0a-42dc-9dba-456c3508b888 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045519 Oct 28 09:00:23.973814 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 789/1559] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 09:00:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:00:24.013044 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-15fb2151-7be0-4dbc-8f08-1d090b133fe9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:00:24.022442 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-15fb2151-7be0-4dbc-8f08-1d090b133fe9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1" status: 200 len: 1265 microversion: 2.1 time: 0.315312 Oct 28 09:00:24.023458 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 771/1560] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 09:00:23 2021] GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1 => generated 1265 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:00:25.041208 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-845d4744-d04f-4d8b-9fec-0516e094bafb tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:00:25.042023 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-845d4744-d04f-4d8b-9fec-0516e094bafb tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 604be8f6-1220-4068-aa90-4d001713b8c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:00:25.048446 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-845d4744-d04f-4d8b-9fec-0516e094bafb tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:25.049074 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-845d4744-d04f-4d8b-9fec-0516e094bafb tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:25.049861 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-845d4744-d04f-4d8b-9fec-0516e094bafb tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:25.050422 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-845d4744-d04f-4d8b-9fec-0516e094bafb tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:25.183403 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-845d4744-d04f-4d8b-9fec-0516e094bafb tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:00:25.191664 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-845d4744-d04f-4d8b-9fec-0516e094bafb tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1" status: 200 len: 1265 microversion: 2.1 time: 0.154845 Oct 28 09:00:25.192235 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 790/1561] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 09:00:25 2021] GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:00:26.207994 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f9745f8e-4eda-4114-8f23-3841f6f0221d tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:00:26.208650 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f9745f8e-4eda-4114-8f23-3841f6f0221d tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 604be8f6-1220-4068-aa90-4d001713b8c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:00:26.215089 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9745f8e-4eda-4114-8f23-3841f6f0221d tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:26.215533 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9745f8e-4eda-4114-8f23-3841f6f0221d tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:26.216304 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9745f8e-4eda-4114-8f23-3841f6f0221d tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:26.216735 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9745f8e-4eda-4114-8f23-3841f6f0221d tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:26.343793 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-f9745f8e-4eda-4114-8f23-3841f6f0221d tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:00:26.352038 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f9745f8e-4eda-4114-8f23-3841f6f0221d tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1" status: 200 len: 1265 microversion: 2.1 time: 0.148098 Oct 28 09:00:26.352538 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 772/1562] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 09:00:26 2021] GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:00:27.369652 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3abda5d6-9157-48e6-bca1-8cb4e31792d0 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:00:27.370233 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3abda5d6-9157-48e6-bca1-8cb4e31792d0 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 604be8f6-1220-4068-aa90-4d001713b8c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:00:27.377272 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3abda5d6-9157-48e6-bca1-8cb4e31792d0 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:27.377726 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3abda5d6-9157-48e6-bca1-8cb4e31792d0 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:27.378522 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3abda5d6-9157-48e6-bca1-8cb4e31792d0 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:27.378949 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3abda5d6-9157-48e6-bca1-8cb4e31792d0 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:27.508563 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-3abda5d6-9157-48e6-bca1-8cb4e31792d0 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:00:27.515961 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3abda5d6-9157-48e6-bca1-8cb4e31792d0 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1" status: 200 len: 1265 microversion: 2.1 time: 0.150069 Oct 28 09:00:27.516598 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 791/1563] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 09:00:27 2021] GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:00:28.533005 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9dbc6c40-f79d-43c0-b74e-5502dfce6c8a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:00:28.533546 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9dbc6c40-f79d-43c0-b74e-5502dfce6c8a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 604be8f6-1220-4068-aa90-4d001713b8c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:00:28.539924 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dbc6c40-f79d-43c0-b74e-5502dfce6c8a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:28.540368 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dbc6c40-f79d-43c0-b74e-5502dfce6c8a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:28.541140 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dbc6c40-f79d-43c0-b74e-5502dfce6c8a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:28.541570 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dbc6c40-f79d-43c0-b74e-5502dfce6c8a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:28.671138 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-9dbc6c40-f79d-43c0-b74e-5502dfce6c8a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:00:28.680236 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9dbc6c40-f79d-43c0-b74e-5502dfce6c8a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1" status: 200 len: 1265 microversion: 2.1 time: 0.151102 Oct 28 09:00:28.680811 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 773/1564] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 09:00:28 2021] GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:00:29.697836 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2051047a-f44e-454f-affb-d78d91efa3fc tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:00:29.698432 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2051047a-f44e-454f-affb-d78d91efa3fc tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 604be8f6-1220-4068-aa90-4d001713b8c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:00:29.705560 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2051047a-f44e-454f-affb-d78d91efa3fc tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:29.706003 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2051047a-f44e-454f-affb-d78d91efa3fc tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:29.709475 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2051047a-f44e-454f-affb-d78d91efa3fc tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:29.709475 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2051047a-f44e-454f-affb-d78d91efa3fc tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:29.838034 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-2051047a-f44e-454f-affb-d78d91efa3fc tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:00:29.846698 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2051047a-f44e-454f-affb-d78d91efa3fc tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1" status: 200 len: 1265 microversion: 2.1 time: 0.152445 Oct 28 09:00:29.847283 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 792/1565] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 09:00:29 2021] GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:00:30.863840 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-203c43cc-0e4f-4497-b883-705de12cb532 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:00:30.864461 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-203c43cc-0e4f-4497-b883-705de12cb532 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 604be8f6-1220-4068-aa90-4d001713b8c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:00:30.870771 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-203c43cc-0e4f-4497-b883-705de12cb532 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:30.871244 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-203c43cc-0e4f-4497-b883-705de12cb532 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:30.872005 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-203c43cc-0e4f-4497-b883-705de12cb532 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:30.872434 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-203c43cc-0e4f-4497-b883-705de12cb532 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:31.010326 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-203c43cc-0e4f-4497-b883-705de12cb532 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:00:31.017872 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-203c43cc-0e4f-4497-b883-705de12cb532 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1" status: 200 len: 1265 microversion: 2.1 time: 0.157721 Oct 28 09:00:31.018434 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 774/1566] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 09:00:30 2021] GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:00:32.034595 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ca098809-5067-466d-8f79-4f01ae734272 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:00:32.035332 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ca098809-5067-466d-8f79-4f01ae734272 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 604be8f6-1220-4068-aa90-4d001713b8c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:00:32.041384 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca098809-5067-466d-8f79-4f01ae734272 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:32.041827 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca098809-5067-466d-8f79-4f01ae734272 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:32.042616 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca098809-5067-466d-8f79-4f01ae734272 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:32.043043 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca098809-5067-466d-8f79-4f01ae734272 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:32.164474 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-ca098809-5067-466d-8f79-4f01ae734272 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:00:32.171735 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ca098809-5067-466d-8f79-4f01ae734272 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1" status: 200 len: 1265 microversion: 2.1 time: 0.140869 Oct 28 09:00:32.172300 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 793/1567] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 09:00:32 2021] GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1 => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:00:33.188604 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-65a46323-0053-40a0-b4be-3631e940d433 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:00:33.189215 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-65a46323-0053-40a0-b4be-3631e940d433 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 604be8f6-1220-4068-aa90-4d001713b8c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:00:33.196295 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65a46323-0053-40a0-b4be-3631e940d433 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:33.196744 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65a46323-0053-40a0-b4be-3631e940d433 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:33.197529 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65a46323-0053-40a0-b4be-3631e940d433 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:33.198000 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65a46323-0053-40a0-b4be-3631e940d433 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:33.330335 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-65a46323-0053-40a0-b4be-3631e940d433 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:00:33.338069 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-65a46323-0053-40a0-b4be-3631e940d433 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1" status: 200 len: 1265 microversion: 2.1 time: 0.153207 Oct 28 09:00:33.338665 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 775/1568] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 09:00:33 2021] GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:00:34.356216 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0c48864f-110d-461c-8c30-a61460b76ec9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:00:34.356766 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0c48864f-110d-461c-8c30-a61460b76ec9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 604be8f6-1220-4068-aa90-4d001713b8c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:00:34.363877 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c48864f-110d-461c-8c30-a61460b76ec9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:34.364330 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c48864f-110d-461c-8c30-a61460b76ec9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:34.365124 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c48864f-110d-461c-8c30-a61460b76ec9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:34.365554 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c48864f-110d-461c-8c30-a61460b76ec9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:34.492039 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-0c48864f-110d-461c-8c30-a61460b76ec9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:00:34.499409 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0c48864f-110d-461c-8c30-a61460b76ec9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1" status: 200 len: 1265 microversion: 2.1 time: 0.147006 Oct 28 09:00:34.499983 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 794/1569] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 09:00:34 2021] GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:00:35.517760 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aa190a54-8a14-40ef-a066-ee7681db8854 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:00:35.522819 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-aa190a54-8a14-40ef-a066-ee7681db8854 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 604be8f6-1220-4068-aa90-4d001713b8c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:00:35.524864 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa190a54-8a14-40ef-a066-ee7681db8854 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:35.525320 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa190a54-8a14-40ef-a066-ee7681db8854 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:35.526100 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa190a54-8a14-40ef-a066-ee7681db8854 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:35.526772 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa190a54-8a14-40ef-a066-ee7681db8854 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:35.652596 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-aa190a54-8a14-40ef-a066-ee7681db8854 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:00:35.660194 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-aa190a54-8a14-40ef-a066-ee7681db8854 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1" status: 200 len: 1265 microversion: 2.1 time: 0.146463 Oct 28 09:00:35.660780 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 776/1570] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 09:00:35 2021] GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:00:36.676735 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-40a22bde-a1e1-4990-9fc7-9a1632b62a80 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:00:36.677343 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-40a22bde-a1e1-4990-9fc7-9a1632b62a80 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 604be8f6-1220-4068-aa90-4d001713b8c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:00:36.683550 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-40a22bde-a1e1-4990-9fc7-9a1632b62a80 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:36.683992 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-40a22bde-a1e1-4990-9fc7-9a1632b62a80 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:36.684751 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-40a22bde-a1e1-4990-9fc7-9a1632b62a80 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:36.685176 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-40a22bde-a1e1-4990-9fc7-9a1632b62a80 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:36.814463 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-40a22bde-a1e1-4990-9fc7-9a1632b62a80 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:00:36.822078 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-40a22bde-a1e1-4990-9fc7-9a1632b62a80 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1" status: 200 len: 1265 microversion: 2.1 time: 0.148889 Oct 28 09:00:36.822658 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 795/1571] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 09:00:36 2021] GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:00:36.920584 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-38bbf960-f551-4d54-a9df-73984a76a58a req-8c388b9c-db04-4ca4-be6f-08da527c568c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "604be8f6-1220-4068-aa90-4d001713b8c1", "name": "network-vif-plugged", "status": "completed", "tag": "2567d8cf-e597-49a2-ae06-eb28e53b53f1"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:00:36.922167 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:00:36.922167 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 09:00:36.930129 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-38bbf960-f551-4d54-a9df-73984a76a58a req-8c388b9c-db04-4ca4-be6f-08da527c568c service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:36.930597 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-38bbf960-f551-4d54-a9df-73984a76a58a req-8c388b9c-db04-4ca4-be6f-08da527c568c service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:36.941973 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-38bbf960-f551-4d54-a9df-73984a76a58a req-8c388b9c-db04-4ca4-be6f-08da527c568c service nova] Creating event network-vif-plugged:2567d8cf-e597-49a2-ae06-eb28e53b53f1 for instance 604be8f6-1220-4068-aa90-4d001713b8c1 on hv-cinder-81565 Oct 28 09:00:36.948126 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-38bbf960-f551-4d54-a9df-73984a76a58a req-8c388b9c-db04-4ca4-be6f-08da527c568c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031230 Oct 28 09:00:36.948783 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 777/1572] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 09:00:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:00:37.839727 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d674af46-2c85-476c-a0a0-e0dd56b3fe74 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:00:37.840326 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d674af46-2c85-476c-a0a0-e0dd56b3fe74 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 604be8f6-1220-4068-aa90-4d001713b8c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:00:37.847492 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d674af46-2c85-476c-a0a0-e0dd56b3fe74 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:37.847938 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d674af46-2c85-476c-a0a0-e0dd56b3fe74 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:37.848706 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d674af46-2c85-476c-a0a0-e0dd56b3fe74 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:37.849137 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d674af46-2c85-476c-a0a0-e0dd56b3fe74 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:37.975415 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-d674af46-2c85-476c-a0a0-e0dd56b3fe74 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:00:37.982806 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d674af46-2c85-476c-a0a0-e0dd56b3fe74 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1" status: 200 len: 1265 microversion: 2.1 time: 0.146825 Oct 28 09:00:37.983374 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 796/1573] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 09:00:37 2021] GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:00:39.001096 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-644fa77a-2bc8-4000-9747-cc6562fca637 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:00:39.001820 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-644fa77a-2bc8-4000-9747-cc6562fca637 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 604be8f6-1220-4068-aa90-4d001713b8c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:00:39.008015 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-644fa77a-2bc8-4000-9747-cc6562fca637 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:39.008457 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-644fa77a-2bc8-4000-9747-cc6562fca637 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:39.009217 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-644fa77a-2bc8-4000-9747-cc6562fca637 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:39.009641 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-644fa77a-2bc8-4000-9747-cc6562fca637 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:39.135361 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-644fa77a-2bc8-4000-9747-cc6562fca637 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:00:39.143733 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-644fa77a-2bc8-4000-9747-cc6562fca637 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1" status: 200 len: 1453 microversion: 2.1 time: 0.147336 Oct 28 09:00:39.144320 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 778/1574] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 09:00:38 2021] GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1 => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:00:39.166438 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fcf72218-00e0-4968-a516-1a3d9d488a1a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:00:39.167062 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fcf72218-00e0-4968-a516-1a3d9d488a1a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 604be8f6-1220-4068-aa90-4d001713b8c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:00:39.173449 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcf72218-00e0-4968-a516-1a3d9d488a1a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:39.173889 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcf72218-00e0-4968-a516-1a3d9d488a1a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:39.174704 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcf72218-00e0-4968-a516-1a3d9d488a1a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:39.175135 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcf72218-00e0-4968-a516-1a3d9d488a1a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:39.301635 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-fcf72218-00e0-4968-a516-1a3d9d488a1a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:00:39.309082 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fcf72218-00e0-4968-a516-1a3d9d488a1a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1" status: 200 len: 1453 microversion: 2.1 time: 0.146445 Oct 28 09:00:39.309652 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 797/1575] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 09:00:39 2021] GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1 => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:00:41.136860 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-2516afb1-8ec4-4e32-b430-95285113c615 req-2aafcdda-52b6-4d56-8e06-0323c672d6c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "604be8f6-1220-4068-aa90-4d001713b8c1", "tag": "2567d8cf-e597-49a2-ae06-eb28e53b53f1"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:00:41.138327 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:00:41.138327 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 09:00:41.145017 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2516afb1-8ec4-4e32-b430-95285113c615 req-2aafcdda-52b6-4d56-8e06-0323c672d6c1 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:00:41.145453 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2516afb1-8ec4-4e32-b430-95285113c615 req-2aafcdda-52b6-4d56-8e06-0323c672d6c1 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:00:41.155947 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-2516afb1-8ec4-4e32-b430-95285113c615 req-2aafcdda-52b6-4d56-8e06-0323c672d6c1 service nova] Creating event network-changed:2567d8cf-e597-49a2-ae06-eb28e53b53f1 for instance 604be8f6-1220-4068-aa90-4d001713b8c1 on hv-cinder-81565 Oct 28 09:00:41.161525 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-2516afb1-8ec4-4e32-b430-95285113c615 req-2aafcdda-52b6-4d56-8e06-0323c672d6c1 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089781 Oct 28 09:00:41.162043 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 779/1576] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 09:00:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:01:43.578959 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 09:01:43.579709 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: Thu Oct 28 09:01:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 09:02:44.184640 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9ae4062d-fb55-4060-9577-1f97c1e8daac] AMQP server on 10.222.0.76:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 28 09:02:44.185448 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-025555cc-2fd7-47b2-928e-48f812ed3ff2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:02:44.186015 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-025555cc-2fd7-47b2-928e-48f812ed3ff2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 604be8f6-1220-4068-aa90-4d001713b8c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:02:44.188819 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-70dd3c18-680e-4f63-bd04-6ae4005f2532 req-68ca50f2-07ae-419d-bbd7-bf1e264ba740 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "604be8f6-1220-4068-aa90-4d001713b8c1", "tag": "2567d8cf-e597-49a2-ae06-eb28e53b53f1"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:02:44.190317 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:02:44.190317 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 09:02:44.193022 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-025555cc-2fd7-47b2-928e-48f812ed3ff2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:44.193882 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-025555cc-2fd7-47b2-928e-48f812ed3ff2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:44.194929 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-025555cc-2fd7-47b2-928e-48f812ed3ff2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:44.195644 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-025555cc-2fd7-47b2-928e-48f812ed3ff2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:44.198142 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-70dd3c18-680e-4f63-bd04-6ae4005f2532 req-68ca50f2-07ae-419d-bbd7-bf1e264ba740 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:44.198619 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-70dd3c18-680e-4f63-bd04-6ae4005f2532 req-68ca50f2-07ae-419d-bbd7-bf1e264ba740 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:44.209881 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-70dd3c18-680e-4f63-bd04-6ae4005f2532 req-68ca50f2-07ae-419d-bbd7-bf1e264ba740 service nova] Creating event network-changed:2567d8cf-e597-49a2-ae06-eb28e53b53f1 for instance 604be8f6-1220-4068-aa90-4d001713b8c1 on hv-cinder-81565 Oct 28 09:02:44.215408 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-70dd3c18-680e-4f63-bd04-6ae4005f2532 req-68ca50f2-07ae-419d-bbd7-bf1e264ba740 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032824 Oct 28 09:02:44.216006 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 780/1577] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 09:02:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:02:44.223099 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-025555cc-2fd7-47b2-928e-48f812ed3ff2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 604be8f6-1220-4068-aa90-4d001713b8c1] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 09:02:44.309628 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-025555cc-2fd7-47b2-928e-48f812ed3ff2 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "DELETE /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1" status: 204 len: 0 microversion: 2.1 time: 0.129374 Oct 28 09:02:44.310536 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 798/1578] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Oct 28 09:02:44 2021] DELETE /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:02:44.320295 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-304c1beb-269f-4e59-b419-814f6b4067e9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:02:44.321508 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-304c1beb-269f-4e59-b419-814f6b4067e9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 604be8f6-1220-4068-aa90-4d001713b8c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:02:44.328081 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-304c1beb-269f-4e59-b419-814f6b4067e9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:44.328519 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-304c1beb-269f-4e59-b419-814f6b4067e9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:44.329290 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-304c1beb-269f-4e59-b419-814f6b4067e9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:44.329760 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-304c1beb-269f-4e59-b419-814f6b4067e9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:44.542277 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-304c1beb-269f-4e59-b419-814f6b4067e9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:02:44.550302 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-304c1beb-269f-4e59-b419-814f6b4067e9 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1" status: 200 len: 1577 microversion: 2.1 time: 0.235024 Oct 28 09:02:44.551004 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 781/1579] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 09:02:44 2021] GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1 => generated 1577 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:02:45.569245 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1b1197f5-226a-427d-993b-b33d0e7bdefd tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:02:45.570225 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1b1197f5-226a-427d-993b-b33d0e7bdefd tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 604be8f6-1220-4068-aa90-4d001713b8c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:02:45.576669 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b1197f5-226a-427d-993b-b33d0e7bdefd tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:45.577208 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b1197f5-226a-427d-993b-b33d0e7bdefd tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:45.577877 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b1197f5-226a-427d-993b-b33d0e7bdefd tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:45.578309 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b1197f5-226a-427d-993b-b33d0e7bdefd tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:45.707965 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-1b1197f5-226a-427d-993b-b33d0e7bdefd tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:02:45.715780 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1b1197f5-226a-427d-993b-b33d0e7bdefd tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1" status: 200 len: 1459 microversion: 2.1 time: 0.151310 Oct 28 09:02:45.716361 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 799/1580] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 09:02:45 2021] GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1 => generated 1459 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:02:46.735635 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dec39dd8-e071-41e8-9c80-4bdf41d0ee2e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:02:46.737472 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dec39dd8-e071-41e8-9c80-4bdf41d0ee2e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 604be8f6-1220-4068-aa90-4d001713b8c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:02:46.745508 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dec39dd8-e071-41e8-9c80-4bdf41d0ee2e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:46.746064 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dec39dd8-e071-41e8-9c80-4bdf41d0ee2e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:46.747360 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dec39dd8-e071-41e8-9c80-4bdf41d0ee2e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:46.748121 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dec39dd8-e071-41e8-9c80-4bdf41d0ee2e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:46.754115 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] [9ae4062d-fb55-4060-9577-1f97c1e8daac] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 42108. Oct 28 09:02:46.791921 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-48b7213a-daa2-4c80-ba25-ec40ef0650f3 req-312f45f4-bdf4-433c-aba2-c97e5eb286f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "604be8f6-1220-4068-aa90-4d001713b8c1", "name": "network-vif-deleted", "tag": "2567d8cf-e597-49a2-ae06-eb28e53b53f1"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:02:46.793789 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:02:46.793789 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 09:02:46.802881 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-48b7213a-daa2-4c80-ba25-ec40ef0650f3 req-312f45f4-bdf4-433c-aba2-c97e5eb286f0 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:46.803405 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-48b7213a-daa2-4c80-ba25-ec40ef0650f3 req-312f45f4-bdf4-433c-aba2-c97e5eb286f0 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:46.818412 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-48b7213a-daa2-4c80-ba25-ec40ef0650f3 req-312f45f4-bdf4-433c-aba2-c97e5eb286f0 service nova] Creating event network-vif-deleted:2567d8cf-e597-49a2-ae06-eb28e53b53f1 for instance 604be8f6-1220-4068-aa90-4d001713b8c1 on hv-cinder-81565 Oct 28 09:02:46.820349 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-dec39dd8-e071-41e8-9c80-4bdf41d0ee2e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:02:46.823373 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-48b7213a-daa2-4c80-ba25-ec40ef0650f3 req-312f45f4-bdf4-433c-aba2-c97e5eb286f0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102562 Oct 28 09:02:46.824348 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 782/1581] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 09:02:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:02:46.828539 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dec39dd8-e071-41e8-9c80-4bdf41d0ee2e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1" status: 200 len: 1225 microversion: 2.1 time: 0.097388 Oct 28 09:02:46.829080 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 800/1582] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 09:02:46 2021] GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:02:47.847496 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d80d6283-fc9e-4f8a-a7ad-093739bad27f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:02:47.848205 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d80d6283-fc9e-4f8a-a7ad-093739bad27f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 604be8f6-1220-4068-aa90-4d001713b8c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:02:47.854289 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d80d6283-fc9e-4f8a-a7ad-093739bad27f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:47.854770 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d80d6283-fc9e-4f8a-a7ad-093739bad27f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:47.855562 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d80d6283-fc9e-4f8a-a7ad-093739bad27f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:47.855996 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d80d6283-fc9e-4f8a-a7ad-093739bad27f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:47.869456 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-d80d6283-fc9e-4f8a-a7ad-093739bad27f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] HTTP exception thrown: Instance 604be8f6-1220-4068-aa90-4d001713b8c1 could not be found. Oct 28 09:02:47.870031 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d80d6283-fc9e-4f8a-a7ad-093739bad27f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Returning 404 to user: Instance 604be8f6-1220-4068-aa90-4d001713b8c1 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:02:47.870863 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d80d6283-fc9e-4f8a-a7ad-093739bad27f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1" status: 404 len: 111 microversion: 2.1 time: 0.028015 Oct 28 09:02:47.871378 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 783/1583] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 09:02:47 2021] GET /compute/v2.1/servers/604be8f6-1220-4068-aa90-4d001713b8c1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:02:51.176669 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8bde12a4-6c5c-4e40-8dc1-7b482b7c726e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:02:51.177864 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8bde12a4-6c5c-4e40-8dc1-7b482b7c726e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: cef0d208-c139-4164-ab75-a4172916e47f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:02:51.180297 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-0bfb0748-4d7e-4e30-a639-d2755ab542a3 req-59967962-2e47-4751-9a7f-80975d18d26e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cef0d208-c139-4164-ab75-a4172916e47f", "tag": "3d21ebbc-3cae-4880-8a80-7a32fcbd7d15"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:02:51.181876 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:02:51.181876 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 09:02:51.184407 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bde12a4-6c5c-4e40-8dc1-7b482b7c726e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:51.185105 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bde12a4-6c5c-4e40-8dc1-7b482b7c726e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:51.185875 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bde12a4-6c5c-4e40-8dc1-7b482b7c726e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:51.186483 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bde12a4-6c5c-4e40-8dc1-7b482b7c726e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:51.189929 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0bfb0748-4d7e-4e30-a639-d2755ab542a3 req-59967962-2e47-4751-9a7f-80975d18d26e service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:51.190374 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0bfb0748-4d7e-4e30-a639-d2755ab542a3 req-59967962-2e47-4751-9a7f-80975d18d26e service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:51.203116 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-0bfb0748-4d7e-4e30-a639-d2755ab542a3 req-59967962-2e47-4751-9a7f-80975d18d26e service nova] Creating event network-changed:3d21ebbc-3cae-4880-8a80-7a32fcbd7d15 for instance cef0d208-c139-4164-ab75-a4172916e47f on hv-cinder-81565 Oct 28 09:02:51.209343 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-0bfb0748-4d7e-4e30-a639-d2755ab542a3 req-59967962-2e47-4751-9a7f-80975d18d26e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033374 Oct 28 09:02:51.210543 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 784/1584] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 09:02:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:02:51.213126 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8bde12a4-6c5c-4e40-8dc1-7b482b7c726e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: cef0d208-c139-4164-ab75-a4172916e47f] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 09:02:51.293457 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8bde12a4-6c5c-4e40-8dc1-7b482b7c726e tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "DELETE /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f" status: 204 len: 0 microversion: 2.1 time: 0.120037 Oct 28 09:02:51.295741 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 801/1585] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Oct 28 09:02:51 2021] DELETE /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:02:51.305401 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c4247061-832e-4eb6-af13-ecef4f4e5456 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:02:51.306438 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c4247061-832e-4eb6-af13-ecef4f4e5456 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: cef0d208-c139-4164-ab75-a4172916e47f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:02:51.313623 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4247061-832e-4eb6-af13-ecef4f4e5456 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:51.314079 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4247061-832e-4eb6-af13-ecef4f4e5456 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:51.314883 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4247061-832e-4eb6-af13-ecef4f4e5456 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:51.315476 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4247061-832e-4eb6-af13-ecef4f4e5456 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:51.531043 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.policy [None req-c4247061-832e-4eb6-af13-ecef4f4e5456 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:02:51.539206 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c4247061-832e-4eb6-af13-ecef4f4e5456 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f" status: 200 len: 1577 microversion: 2.1 time: 0.238967 Oct 28 09:02:51.539793 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 785/1586] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 09:02:51 2021] GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f => generated 1577 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:02:52.556538 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f55050e8-fe13-4684-be81-8484782b1f22 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:02:52.557230 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f55050e8-fe13-4684-be81-8484782b1f22 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: cef0d208-c139-4164-ab75-a4172916e47f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:02:52.563181 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f55050e8-fe13-4684-be81-8484782b1f22 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:52.563661 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f55050e8-fe13-4684-be81-8484782b1f22 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:52.564422 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f55050e8-fe13-4684-be81-8484782b1f22 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:52.564852 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f55050e8-fe13-4684-be81-8484782b1f22 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:52.690940 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-f55050e8-fe13-4684-be81-8484782b1f22 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:02:52.698766 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f55050e8-fe13-4684-be81-8484782b1f22 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f" status: 200 len: 1458 microversion: 2.1 time: 0.146853 Oct 28 09:02:52.699401 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 802/1587] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 09:02:52 2021] GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f => generated 1458 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:02:53.581453 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-f02cc834-9687-491a-98e4-c415b759c8c3 req-e3b38611-d51e-47b5-b92f-3e87dfdf7fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cef0d208-c139-4164-ab75-a4172916e47f", "name": "network-vif-deleted", "tag": "3d21ebbc-3cae-4880-8a80-7a32fcbd7d15"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:02:53.585702 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:02:53.585702 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: warnings.warn(msg) Oct 28 09:02:53.593487 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f02cc834-9687-491a-98e4-c415b759c8c3 req-e3b38611-d51e-47b5-b92f-3e87dfdf7fe4 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:53.593931 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f02cc834-9687-491a-98e4-c415b759c8c3 req-e3b38611-d51e-47b5-b92f-3e87dfdf7fe4 service nova] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:53.606594 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-f02cc834-9687-491a-98e4-c415b759c8c3 req-e3b38611-d51e-47b5-b92f-3e87dfdf7fe4 service nova] Creating event network-vif-deleted:3d21ebbc-3cae-4880-8a80-7a32fcbd7d15 for instance cef0d208-c139-4164-ab75-a4172916e47f on hv-cinder-81565 Oct 28 09:02:53.611584 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-f02cc834-9687-491a-98e4-c415b759c8c3 req-e3b38611-d51e-47b5-b92f-3e87dfdf7fe4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033938 Oct 28 09:02:53.612110 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 786/1588] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Oct 28 09:02:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:02:53.715920 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fee0c93f-ddd8-476d-aa4a-9e0f44888e9a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:02:53.716552 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fee0c93f-ddd8-476d-aa4a-9e0f44888e9a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: cef0d208-c139-4164-ab75-a4172916e47f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:02:53.722788 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fee0c93f-ddd8-476d-aa4a-9e0f44888e9a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:53.723234 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fee0c93f-ddd8-476d-aa4a-9e0f44888e9a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:53.724138 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fee0c93f-ddd8-476d-aa4a-9e0f44888e9a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:53.724573 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fee0c93f-ddd8-476d-aa4a-9e0f44888e9a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:53.786260 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.policy [None req-fee0c93f-ddd8-476d-aa4a-9e0f44888e9a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ef7b4e60214c6c9b5839e9ccfaad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623855e29a5d4365b1dc09eed95a5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:02:53.795282 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fee0c93f-ddd8-476d-aa4a-9e0f44888e9a tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f" status: 200 len: 1225 microversion: 2.1 time: 0.082831 Oct 28 09:02:53.795829 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 803/1589] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 09:02:53 2021] GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:02:54.144065 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 09:02:54.144230 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: Thu Oct 28 09:02:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 09:02:54.815004 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9f758ba8-eb13-4cd7-a151-b915c5581c3f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:02:54.815800 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9f758ba8-eb13-4cd7-a151-b915c5581c3f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: cef0d208-c139-4164-ab75-a4172916e47f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:02:54.822530 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f758ba8-eb13-4cd7-a151-b915c5581c3f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:54.823018 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f758ba8-eb13-4cd7-a151-b915c5581c3f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:54.823803 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f758ba8-eb13-4cd7-a151-b915c5581c3f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:54.824241 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f758ba8-eb13-4cd7-a151-b915c5581c3f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:54.837956 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-9f758ba8-eb13-4cd7-a151-b915c5581c3f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] HTTP exception thrown: Instance cef0d208-c139-4164-ab75-a4172916e47f could not be found. Oct 28 09:02:54.838582 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9f758ba8-eb13-4cd7-a151-b915c5581c3f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Returning 404 to user: Instance cef0d208-c139-4164-ab75-a4172916e47f could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:02:54.839426 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9f758ba8-eb13-4cd7-a151-b915c5581c3f tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f" status: 404 len: 111 microversion: 2.1 time: 0.029027 Oct 28 09:02:54.839984 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 787/1590] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 09:02:54 2021] GET /compute/v2.1/servers/cef0d208-c139-4164-ab75-a4172916e47f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:02:55.289777 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e0c9cacf-fd6a-4a7c-a367-37b261ff45da tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:02:55.290292 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e0c9cacf-fd6a-4a7c-a367-37b261ff45da tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 8a35e8fe-5996-4f86-9273-435cbf4967ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:02:55.296448 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0c9cacf-fd6a-4a7c-a367-37b261ff45da tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:55.296827 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0c9cacf-fd6a-4a7c-a367-37b261ff45da tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:55.297576 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0c9cacf-fd6a-4a7c-a367-37b261ff45da tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:55.298028 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0c9cacf-fd6a-4a7c-a367-37b261ff45da tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:55.310686 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-e0c9cacf-fd6a-4a7c-a367-37b261ff45da tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] HTTP exception thrown: Instance 8a35e8fe-5996-4f86-9273-435cbf4967ae could not be found. Oct 28 09:02:55.311261 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e0c9cacf-fd6a-4a7c-a367-37b261ff45da tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Returning 404 to user: Instance 8a35e8fe-5996-4f86-9273-435cbf4967ae could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:02:55.312054 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e0c9cacf-fd6a-4a7c-a367-37b261ff45da tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "DELETE /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae" status: 404 len: 111 microversion: 2.1 time: 0.027036 Oct 28 09:02:55.312654 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 804/1591] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Oct 28 09:02:55 2021] DELETE /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:02:55.320589 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-663b670a-0774-437d-b15d-79349fc74d51 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:02:55.321200 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-663b670a-0774-437d-b15d-79349fc74d51 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] [instance: 8a35e8fe-5996-4f86-9273-435cbf4967ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:02:55.326980 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-663b670a-0774-437d-b15d-79349fc74d51 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:55.327425 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-663b670a-0774-437d-b15d-79349fc74d51 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:55.328193 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-663b670a-0774-437d-b15d-79349fc74d51 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:02:55.328624 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-663b670a-0774-437d-b15d-79349fc74d51 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Lock "a857be9c-0064-448f-960e-2be952756e52" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:02:55.342827 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-663b670a-0774-437d-b15d-79349fc74d51 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] HTTP exception thrown: Instance 8a35e8fe-5996-4f86-9273-435cbf4967ae could not be found. Oct 28 09:02:55.343477 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-663b670a-0774-437d-b15d-79349fc74d51 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Returning 404 to user: Instance 8a35e8fe-5996-4f86-9273-435cbf4967ae could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:02:55.344338 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-663b670a-0774-437d-b15d-79349fc74d51 tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae" status: 404 len: 111 microversion: 2.1 time: 0.027523 Oct 28 09:02:55.344893 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 788/1592] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Oct 28 09:02:55 2021] GET /compute/v2.1/servers/8a35e8fe-5996-4f86-9273-435cbf4967ae => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:02:56.643278 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ad056bbc-47f7-4647-9627-0f81ebbe75da tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] Calling method '.version_select at 0x7fed737efc10>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:02:56.667193 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ad056bbc-47f7-4647-9627-0f81ebbe75da tempest-TestVolumeBootPattern-789832246 tempest-TestVolumeBootPattern-789832246-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2085811625" status: 202 len: 0 microversion: 2.1 time: 0.027552 Oct 28 09:02:56.667770 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 805/1593] 10.222.0.76 () {58 vars in 1262 bytes} [Thu Oct 28 09:02:56 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2085811625 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:03:14.293720 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 09:03:14.294573 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: Thu Oct 28 09:03:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 09:03:15.151059 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 09:03:15.151619 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: Thu Oct 28 09:03:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 09:05:03.597915 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 09:05:03.599308 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: Thu Oct 28 09:05:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 09:05:17.216628 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 09:05:17.217114 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: Thu Oct 28 09:05:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 09:05:20.863141 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 09:05:20.863619 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: Thu Oct 28 09:05:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 09:06:14.163281 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 09:06:14.164054 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: Thu Oct 28 09:06:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 09:06:34.311129 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 09:06:34.311846 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: Thu Oct 28 09:06:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 09:06:35.168266 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 09:06:35.168817 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: Thu Oct 28 09:06:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 09:08:23.616530 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 09:08:23.617293 dv-cinder-815659-2-iscsi devstack@n-api.service[122256]: Thu Oct 28 09:08:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 09:08:37.235303 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 09:08:37.236900 dv-cinder-815659-2-iscsi devstack@n-api.service[122257]: Thu Oct 28 09:08:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!